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SUMMARY 


The  purpose  of  this  report  is  twofold:  first,  to  review  the  literature  on 
factors  which  limit  forward-looking  infrared  (FLIR)  systems  and  their  use 
in  a  European  setting;  and  second,  to  evaluate  empirically  a  current  and 
second-generation  system  in  terms  of  some  of  the  system  parameters 
surveyed.  The  structure  of  the  report  reflects  these  aims. 

The  first  major  section  of  this  report  provides  a  synthesis  of  a  wide  variety 
of  literature  that  most  heavily  deals  with  the  following: 

1)  FLIR  system  uses  within  the  military,  focusing  on 
Air  Force  requirements  in  Europe 

2)  FLIR  system  design  considerations 

li)  Recent  FLIR  system  developments  and  analyses 
4)  Human  operator  performance  using  FLIR  imagery 

The  second  section  of  the  report  describes  an  experiment  undertaken  by 
Honeywell  Systems  and  Research  Center  personnel.  Two  critical  variables 
of  system  performance,  modulation  transfer  function  (MTF)  and  noise 
equivalent  delta  temperature  (NEAT),  were  chosen  for  experimental 
analysis.  The  experiment  used  a  digital  simulation  of  the  minimum  resolv¬ 
able  temperature  (MRT)  paradigm  to  test  two  modeled  FLIR  systems. 
Twelve  male  subjects  with  20/20  uncorrected  vision  served  as  subjects  for 
a  forced-choice  psychophysical  procedure.  Detection  and  recognition  data 
were  collected  for  two  targets  (four-bar  and  square)  in  trials  with  varying 
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levels  of  size,  contrast,  noise,  and  MTF.  The  test  results  were  compared 
with  the  NVL  predictive  model  (Ratches,  et  al.,  1975)  used  to  evaluate  FLIR 
system  performance.  The  empirically  derived  data  agreed  with  the  NVL  predictive 
predictive  MRT  function  with  some  important  differences.  Namely,  the 
subjects'  MRTs  fell  consistently  below  the  predicted  function  values:  also 
experimental  MRTs  showed  a  leveling  at  lower  spatial  frequencies  (larger 
targets). 
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SECTION  I 


FLIR  LITERATURE  REVIEW 


INTRODUCTION 

Within  the  military,  FLIR  systems  enjoy  wide  use.  Applications  arc 
numerous  and  far-ranging.  For  example,  FLIR  systems  are  used  for  tank 
fire  control,  high-speed  aircraft  target  acquisition,  nighttime  surveillance, 
and  nighttime  target  classification  (Klass,  1973;  Maldonato,  1974).  Each 
of  these  uses  takes  advantage  of  the  unique  capabilities  that  FLIR  systems 
afford:  the  ability  to  detect  objects  with  temperatures  significantly  different 
from  their  backgrounds  (for  example,  warm  tanks  that  stand  out  from  their 
cooler  nighttime  backgrounds),  the  daytime  potential  to  sense  camouflaged 
objects  not  readily  seen  or  differentiated  by  TV  sensors  or  human  observers, 
and  the  capability  to  penetrate  fog,  haze,  and  smoke  conditions  that 
generally  limit  the  utility  of  microwave  and  visual  sensors  (Miller,  1973a; 
Lloyd,  1975a).  Under  these  conditions,  the  infrared  range  can  be  three  to 
six  times  that  of  the  visual  range  (Miller,  1973a). 

Unfortunately,  each  use  of  FLIR  requires  that  a  different  set  of  conditions 
be  satisfied  and  raises  unique  problems.  Resolution  requirements  vary, 
depending  on  whether  target  detection  or  recognition  is  desired;  fields  of 
view  must  be  larger  or  smaller,  depending  on  the  area  to  be  covered  in 
order  to  accomplish  a  mission  (compare  pinpointing  a  target  to  landing  a 
helicopter  in  an  unimproved  field  at  night);  system  size  and  weight  must 
be  limited  to  the  extent  that  the  system  should  be  portable  or  cost  and 
power  efficient;  and  so  on. 
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The  FLIR  community's  initial  response  was  to  design  a  separate  FLIR 
system  for  each  application.  In  the  early  1970's,  the  Department  of  Defense, 
Research  and  Engineering  studied  the  situation  and  suggested  that  a  modular 
approach  to  FLIR  design  be  followed.  The  idea  was  to  identify  classes  of 
FLIR  use  and  to  design  a  family  of  FLIR  night-vision  systems  for  each  kind 
of  use.  As  Klass  {1973)  wrote  at  the  time. 

Each  class  of  FLIR  would  include  a  family  of  modular  sub¬ 
systems  to  enable  the  needs  of  any  specific  weapons  system 
to  be  met  by  appropriate  selection  of  subsystems,  rather 
than  designing  a  new  FLIR  for  almost  every  new  application 
as  in  the  past  (p.  17). 

The  modular  concept  has  influenced  FLIR  design  ever  since  (see,  for  example, 
Kruse,  1976). 

Among  the  families  of  modular  systems  identified  were  those  required  for 
high- speed  aircraft  and  for  general  surveillance.  The  rest  of  this  review 
will  focus  on  FLIR  systems  intended  for  these  uses.  This  is  necessary, 
modular  commonality  notwithstanding,  since  different  FLIR  uses  still  have 
different  system  requirements. 

FLIR  USES  IN  A  EUROPEAN  SETTING 

Analyses  of  the  European  scenarios  for  a  1985-1990  time  frame  indicate  a 
variety  of  uses  for  FLIR  systems.  Those  for  advanced  fighter/attack 
aircraft  missions  will  be  dealt  with  here. 


Representative  of  the  advanced  fighter  aircraft  missions  that  are  projected 
for  a  European  theatre  are  the  air-to-ground  missions  discussed  in  a 
recent  document  written  at  Honeywell,  Incorpo rated  (Hanson,  Jones,  Macek, 
Feters,  and  Sandvig,  1978).  The  document  analyzes  specific  types  of 
missions,  among  them  deep  strike  and  battlefield  interdiction.  These 
missions  use  FLIR  systems  in  some  capacity. 

In  the  case  of  the  deep-strike  mission,  it  is  anticipated  that  FLIR  systems 
might  be  used  as  one  of  a  variety  of  alternative  sensor  and  weapon  combin¬ 
ations.  For  example,  a  FLIR  sensor  (with  data  link)  might  be  used  with  a 
GBU-15  type  weapon  in  conjunction  with  a  global  positioning  satellite 
(CPS)  controlled  launch  point  (Hanson,  Jones,  Macek,  Peters,  and  Sandvig, 
1978).  In  the  case  of  the  battlefield  interdiction  mission,  FLIR  systems 
will  enjoy  a  more  prominent  role  as  the  primary  ground  search  sensor.  If 
the  FLIR  devices  used  in  these  missions  are  to  perform  adequately,  they 
must  be  able  to  operate  under  the  sets  of  constraints  determined  by  each 
mission's  purpose  and  the  conditions  under  which  it  is  flown. 

The  purposes  of  the  two  missions  differ.  Deep-strike  missions  attack 
primary  targets  and  installations  at  known  and  relatively  fixed  positions. 
Synthetic  aperture  radar  is  used  as  the  primary  ground  search  sensor.  In 
addition,  target  imagery  is  available  in  advance  of  the  mission.  In  contrast, 
the  battlefield  interdiction  mission  is  conducted  against  weapons,  personnel, 
transportation,  and  ground  force  supplies.  Typically,  the  targets  are  in  a 
known,  but  not  fixed,  position.  Consequently,  target  identification  is 
required  using  aerial  reconnaissance  and  surveillance  sensors  such  as  those 
provided  by  a  FLIR  system. 


3 


Some  of  the  conditions  under  which  the  two  missions  will  have  to  be  flown 
are  different;  notably,  their  flight  profiles:  during  the  attack  phase  of 
the  deep-strike  mission,  high  altitudes  (60,000  ft)  and  supersonic  speeds  are 
attained.  During  the  comparable  phase  of  the  battlefield  interdiction  mission, 
however,  a  low  altitude  and  somewhat  slower  speed  (100  ft;  M  1.2)  (Hanson, 
Jones,  Macek,  Peters,  and  Sandvig,  1978).* 

There  are  other  conditions  under  which  the  two  missions  will  have  to  be 
flown  that  are  comparable  and  require  a  FLIR  sensor's  capabilities.  Each 
requires  operational  capabilities  for  day  and  night  missions  and  each  has 
to  be  flown  in  less  than  optimal  weather  much  of  the  time.  In  Europe,  in 
particular,  one  expects  to  have  to  operate  under  conditions  of  limited 
visibility  characterized  by  a  low  ceiling  (low  clouds)  and  haze  (see  below). 
However,  these  environmental  conditions,  along  with  system  parameters 
and  operator  characteristics,  Jimit  FLIR  system's  performance.  The 
remainder  of  this  review  identifies  the  more  important  of  these  system  and 
operator  factors  and  discusses  their  influences  on  FLIR  system  performance. 

SURVEY  OF  FACTORS  INFLUENCING  FLIR  PERFORMANCE 

Background 

FLIR  systems  are  designed  to  detect  long-wavelength  infrared  radiation 
that  is  received  at  the  sensor.  The  image  produced  by  the  FLIR  system  is 
a  function  of  the  variations  in  the  radiation  received. 


Altitude  and  speed  change  with  the  phase  of  the  missions. 
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There  are  four  sources  of  radiation  in  the  environment:  background, 
foreground,  atmosphere,  and  target  objects.  These  sources  can  contribute 
to  the  variation  of  radiation  in  three  ways:  through  emissivity,  through 
reflection,  and  through  assorption.  These  aspects  of  infrared  radiation 
cause  some  of  the  special  problems  associated  with  FLIR  systems  and  some 
of  the  difficulties  encountered  in  the  interpretation  and  processing  of  FLIR 
imagery. 

Some  of  these  problems  are  best  illuminated  by  a  comparison  of  FLIR 
systems  with  other  electro-optical  devices.  Active  and  passive  TV  systems, 
for  example,  make  use  of  the  visible  spectrum,  sometimes  in  the  near- 
infrared  region.  These  systems  primarily  detect  reflected  light.  Given 
the  constant  reflectivity  of  the  surfaces  present,  as  the  ambient  illumination 
changes  the  modulation  of  the  overall  scene  changes  proportionately.  As  a 
result,  the  dynamic  range  requirements  of  TV  systems  remain  proportionately 
the  same.  This  is  not  the  case  when  one  turns  to  an  infrared  system. 

Because  the  radiation  within  this  region  comes  not  only  from  the  relative 
reflectivity  of  the  environmental  surfaces  viewed  by  an  infrared  sensor, 
but  also  from  the  emissivity  of  the  objects  themselves,  the  infrared 
modulation  of  the  scene  does  not  change  proportionately  with  an  overall 
average  change  (that  is,  with  ambient  coolings  and  warmings).  Because  of 


The  term  active  implies  that  an  auxiliary  scene  irradiator,  located  near  or 
at  the  television  sensor,  is  used.  Passive  systems  do  not  use  such 
auxiliary  irradiators,  relying  instead  on  natural  sources  of  irradiation 
(Sendall  and  Rosell,  1973). 
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this,  dynamic  range  considerations  remain  important.  Large  areas  may 
have  extreme  modulations  but  at  the  same  time  contain  important  smaller 
modulations  that  must  be  detected  (Sendall  and  Rosell,  1973).+ 

Associated  with  the  lack  of  an  invariant  background- object  relationship  is 
another  difference  between  electro- optical  and  infrared  sensors  that  has 
potential  perceptual  significance.  Because  TV  sensors  make  use  of  the 
same  sources  of  information  that  the  human  visual  system  does,  the  imagery 
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Lloyd  writes, 

The  dynamic  range  of  a  system  is  described  by  a  temperature 
difference  dynamic  range  and  by  a  luminance  dynamic  range.  . . 

The  dynamic  range  of  AT  is  the  maximum  scene  AT  which  is 
displayed  unclipped  for  a  particular  condition  of  control  settings. 
The  maximum  dynamic  range  of  AT  is  the  maximum  unclipped 
AT  for  the  lowest  gain  setting.  The  luminance  dynamic  range 
gives  the  maximum  luminance  the  system  produces  (p.  432,  1975b). 

^Narendra,  Tack,  and  Joseph  (1977)  note  the  following- 

Thermal  imagers  have  a  high  inherent  scene  dynamic  range.  For 
example,  the  dynamic  range  of  a  FLIR  scene  with  a  cold  sky  and 
hot  ground  background  can  be  as  high  as  1000:1,  with  a  100  deg 
temperature  range  and  0.1  deg  MRT  (the  minimum  resolvable 
temperature,  which  is  discussed  in  the  text  below).  With  the 
advent  of  higher-sensitivity  detectors  the  dynamic  range  could 
be  even  greater.  This  high  dynamic  range  video  information 
must  be  displayed  on  an  imager  display  that  has  a  luminance 
range  typically  of  15:1  to  30-1.  If  saturation  in  some  part  of 
the  display  and  blackout  in  others  is  to  be  avoided,  the  gain  of 
the  display  should  be  set  very  low.  This  means  that  low 
contrast  (temperature  difference)  information  in  the  scheme  is 
translated  to  even  smaller  luminance  (brightness)  differences 
on  the  display,  and  cannot  be  perceived  by  the  operator  as  it 
falls  below  the  contrast  sensitivity  threshold  (p.  53). 
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produced  corresponds  to  what  an  observer  of  that  scene  would  see. 

Infrared  sensors  provide  a  different  image  of  the  scene.  This  image  has 
both  advantages  and  disadvantages  for  the  operator.  Fundamental  advantages 
derive  from  the  following  two  facts:  (1)  within  the  infrared  range  a  target 
object  acts  as  its  own  source  and  (2)  the  object's  radiation  is  not  blocked 
by  such  things  as  brush,  camouflage,  or  haze  to  the  extent  that  radiation 
in  the  visible  spectrum  is.  Consequently,  object  outlines  remain  relatively 
intact  when  viewed  by  an  infrared  sensor.  Coupled  with  this  outcome  is  the 
further  fact  that  objects  viewed  by  an  infrared  sensor  do  not  produce  real¬ 
time  shadows,  but  only  shadows  that  are  temperature  gradients  built  up 
over  time.  Taken  together,  these  characteristics  of  infrared  imagery  mean 
that  the  objects  imaged  appear  more  distinctive  when  viewed  by  an  infrared 
sensor  than  when  viewed  by  its  electro- optical  counterpart  (Sendall  and 
Rosell,  1973). 


However,  the  very  distinctiveness  of  infrared  imagery  can  present  problems 
insofar  as  the  infrared  signatures  are  perceptually  different  from  the  objects 
as  they  are  seen  visually  or  as  they  might  appear  on  the  display  of  an  electro- 
optical  system.  The  problem  is  discussed  in  the  following  terms  by  Sendall 
and  Rosell  (1973): 

For  the  various  natural  objects,  the  IR  scene  varies  with  aspect 
angle,  foreground,  and  background  as  well  as  atmosphere.  The 
following  summarizes  the  important  parameters  and  their  general 
relationships.  The  emissivity  of  the  various  objects  is  constant 
with  time  (except  for  dew,  etc. )  but  a  function  of  aspect  angle. 

Therefore,  it  is  a  function  of  time  when  the  sensor  is  moving.  The 
temperature  is  a  strong  function  of  time  as  sky  conditions,  air 
temperature,  and  the  effects  of  the  sun  vary  with  time.  The  apparent 
temperature  of  various  areas  of  the  scene  is  a  strong  function  of  the 
actual  temperature,  emissivity,  and  background.  Man-made  objects 
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exhibit  similar  but  different  characteristics.  They  often  have 
their  temperature  determined  by  heat  sources  other  than  the  sun. 

When  the  sun  and  natural  conditions  determine  the  temperature 
variations  on  man-made  objects,  they  present  a  very  natural  TV- 
like  image.  When  they  have  temperature  differences  due  to 
localized  heating,  the  image  can  be  very  unnatural  (pp.  22-23). 

Regardless  of  the  natural  or  unnatural  appearances  of  objects,  their 
detection  and  recognition  is  of  fundamental  military  importance.  Therefore, 
in  order  to  anticipate  FLIR  requirements  for  their  use  in  Europe,  it  is 
worth  enumerating  various  variables  associated  with  FLIR  systems  that 
affect  system /operator  performance  in  general.  Each  variable  can  be 
assigned  to  one  of  three  broad  categories:  environmental,  system,  or 
operator.  In  turn,  each  category  can  be  broken  down  further.  This  has 
been  done  in  Table  1. 

The  influence  of  each  of  these  variable  categories  may  be  characterized 
as  follows: 

Environmental 

1)  Establishes  the  dynamic  range  that  must  be 
handled  by  the  system 

2)  Determines  the  windows  that  transmit  useful 
amounts  of  information  and  the  spectral  char¬ 
acteristics  of  transmittance  through  these  windows 

3)  May  indirectly  influence  resolution  require¬ 
ments  of  the  system  since  amount  of  detail 
required  for  target  detection  or  recognition 
varies  as  a  function  of  clutter  and  contrast 
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TABLE  1.  BREAKDOWN  OF  SOME  OF  THE  VARIABLE  CATEGORIES  THAT 
AFFECT  FLIR  SYSTEM/ OPERATOR  PERFORMANCE 


ENVIRONMENTAL  VARIABLES 

Atmosphere  Scene 

Humidity  Target  characteristics 

Aerosol  content  Background  characteristics 

Cloud  cover  Clutter 

Haze,  smoke,  fog  (and 
other  atmospheric 
suspensions) 


SYSTEM  VARIABLES 

Sensor 

Image  Processing 

Display 

Bandwidth 

Static  &  dynamic 

Luminance 

Number  of  scan  lines 

enhancements 

Size 

MTF 

(for  example. 

Number  of  scan  lines 

Field  of  view 

edge  and  con- 

MTF 

Ficld/frame  rate 

trast  enhance- 

Contrast 

Aspect  ratio 

ments) 

Dynamic  range 

Signal- to-noise  ratio 

Spatial  filtering 

Scene  movement 

Integration  time 

Signal-to-noise  ratio 

Scan  mode-. 

Aspect  ratio 

serial,  parallel 

Gamma 

Detector  detectivity 

Field  of  view 

Detector  architecture 

Bandwidth 

OPERATOR  VARIABLES 

Perceptual 

Situational 

Spatial  integration 

Task  (for  example,  identification 

Temporal  integration 

vs  recognition) 

Contrast  sensitivity 

Briefing 

MTF 

Lighting 

Signal- to- noise  ratio 

Display  vibration  stress 

Light/dark  adaptation  level 

4)  Can  set  sensitivity  requirements  in  that  atmosphere  will 
attenuate  signal  transmission  and  reduce  contrast 


System 

1  )  Influences  bandwidth  of  signal  transmitted 

2)  Affects  bandpass  characteristics  of  the  signal  transmitted 

3)  Affects  signal-to-noise  ratio  and  contrast  of  the  signal 
transmitted 

4)  Affects  display  of  information  that  can  influence  operator 
performance. 


Operator 

1 )  Can  limit  which  signals  are  detectable 

2)  Can  determine  which  signals  are  sufficient  to  accomplish 
particular  tasks 

3)  Can  influence  the  interpretability  of  particular  signals 
Aspects  of  each  variable  category  will  now  be  examined  in  more  detail. 

Environmental  Factors 


Probably  the  most  important  set  of  environmental  variables  that  will  influence 
FL.IR  performance  in  Central  Europe  has  to  do  with  the  atmospheric  conditions 
found  there.  Winter  months  are  often  characterized  by  low  ceilings  and 
limited  visibility.  During  summer  months,  visibility  is  much  improved  and 
cloud  cover  is  not  as  great  a  problem.  These  conditions  are  shown  graphically 
in  Figure  1. 


10 


WINTER  SUMMER 


Figure  1.  Weather  Probability  in  Central  Europe 
(adapted  from  Poise  Sensor ,  1977) 

The  winter  and  summer  months  represent  the  extremes  of  the  observed 
seasonal  variations.  Although  spring  and  fall  lie  within  these  extremes, 
they  seem  to  resemble  the  worst-case  visibility  conditions  more  closely 
than  they  do  the  best-case  conditions.  This  is  shown  in  Figure  2. 

Visibility  is  a  function  of  atmospheric  transmittance  of  the  radiation  and 
varies  as  a  function  of  the  gaseous  and  aerosol  particles  suspended  in  the 
atmosphere.  The  effect  of  these  particles  is  two-fold:  they  both  absorb  and 
scatter  the  radiation  being  transmitted  through  the  atmosphere.  In  either 
case,  they  reduce  target- to-background  contrast  (Poise  Sensor,  1977). 
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Figure  2.  Visibility  Variation  with  Season  in  Eastern  Europe;  cloud 
height  *  500  to  1,000  feet  (Hanson,  et  al. ,  1978,  p.  34.) 

The  principal  absorbers  of  infrared  radiation  are  listed  in  Table  2  in  their 
order  of  importance.  As  each  molecule  absorbs  the  radiation  in  broad  bands, 
the  central  wavelength  of  each  band  is  also  given. 

The  first  three  molecules  are  the  most  significant  sources  of  infrared 
absorption.  Such  absorption  accounts  for  most  of  the  extinction  that  occurs, 
except  where  there  are  dense  suspensions  of  smoke,  fog,  haze,  etc.  How¬ 
ever,  practically  speaking,  the  6.3  pm  water  band  and  the  2.  7  and  15  pm 
carbon  dioxide  bands  limit  atmospheric  transmission  in  the  2  to  20  pm  range 

In  the  lower  atmosphere,  the  extinction  accounted  for  by  nitrous  oxide  and 
carbon  monoxide  is  negligible  (Lloyd,  1975b). 
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TABLE  2.  ABSORBERS  OF  THERMAL  RADIATION 


Molecule 

Wavelengths  around  which 
absorption  is  centered  (pm) 

Water 

2. 7,  3.2,  6.3 

Carbon  Dioxide 

2.7,  4.3,  15 

Ozone 

4.8,  9.6,  14.2 

Nitrous  Oxide 

4.7,  7.8 

Carbon  Monoxide 

4.8 

Methane 

3.2,  7.8 

Based  on  Lloyd,  1975b. 


to  two  atmospheric  "windows,  "  the  3.  5  to  5  pm  and  the  8  to  14  pm 
bandwidths  (Lloyd,  1975b). 

The  8  to  14  pm  bandwidth  has  the  higher  sensitivity  when  no  transmission 
losses  are  considered.  However,  given  the  absorption  effects,  there  are 
relative  advantages  and  disadvantages  for  each  of  the  two  bands.  Carbon 
dioxide  absorbs  radiation  heavily  in  the  3.  5  to  5  pm  range,  making  it  the 
less  preferred  band  for  use  in  mid-latitude  dry  air  masses.  However, 
where  humidity  is  a  factor,  the  3.5  to  5  pm  band  becomes  superior  to  the 
8  to  14  pm  band,  given  the  degree  to  which  water  absorbs  8  to  14  pm 
radiation  (Lloyd,  1975b). 
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The  tradeoffs  become  even  more  complex  when  the  effects  of  scattering  are 
taken  into  account.  Particles  suspended  in  the  atmosphere  not  only  absorb 
radiation,  they  scatter  it.  The  result  for  an  infrared  sensor  system  is  that 
a  signal  becomes  attenuated  for  two  additional  reasons.  First,  the  signal  is 
scattered  outside  its  path  and  second,  background  radiation  is  scattered  into 
its  path  (Tuer,  1977). 

Scattering  is  caused  by  air  molecules  (Rayleigh  scattering)  and  by  aerosol 
particles  (Mie  scattering).  The  magnitude  of  these  effects  for  any  particular 
band  of  radiation  depends  upon  wavelength- particle  size  relationships. 

Because  the  size  of  air  molecules  is  so  small  relative  to  infrared  wavelengths, 
Rayleigh  scattering  is  not  a  major  consideration  for  an  infrared  system 
(Lloyd,  1975b).  However,  aerosol  scattering  is  significant.  Unfortunately, 
its  effects  have  often  been  underestimated  in  performance  evaluations  of 
FLIR  systems,  and  relevant  data  have  been  lacking.  Nonetheless,  Biberman 
(1976)  states  that,  "(ajerosol  effects  are  more  important  than  gaseous 
absorption  for  infrared  systems  in  the  8.5-11  pm  radiation  band.  . .  " 

(p.  43).'" 

Aerosol  particles  that  typically  affect  FLIR  system  performance  are: 
water  droplets,  sand,  salt,  dust,  smoke,  and  soot  (Tuer,  1977;  Poise 
Sensor  Display  Design  Evaluation  Study,  1977).  Because  of  the  size  of  these 
aerosols  relative  to  the  infrared  wavelengths,  aerosol  scattering  attenuates 
radiation  in  the  3.  5  to  5  pm  band  more  than  that  in  the  8  to  14  pm  band  (Lloyd, 
1975b). 


Biberman’s  analysis  does  not  consider  the  shorter  infrared  bandwidth. 
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The  relative  effectiveness  of  these  two  bands  must  be  evaluated  in  the  context 
of  their  intended  use.  For  example,  in  a  European  setting  both  haze  and 
humidity  are  meteorological  factors  that  must  be  dealt  with  (Biberman,  1976; 
Kruse.  1976).  Consequently,  the  haze  penetration  ability  of  an  infrared 
sensor  that  has  a  bandwidth  in  the  8  to  14  inn  range  might  be  offset  to  some 
measurable  extent  by  the  greater  energy  absorption  in  this  band,  which  is 
attributable  to  water.  If,  on  the  other  hand,  a  particular  mission  requires 
detection  over  short  ranges,  the  3.  5  to  5  um  band  may  be  preferred,  since 
attenuation  due  to  scattering  will  be  minimized.  Nevertheless,  it  has  been 
the  general  practice  to  choose  infrared  sensors  that  operate  in  the  8  to  14  pm 
band.  Field  tests  have  shown  this  band  to  have  three  advantages  over  the 
3.  5  to  5  band.  These  are: 

1)  A  higher  signal-to-noise  ratio  for  a  given  set  of  system 
parameters 

2)  Better  atmospheric  transmission  weighted  by  frequency 
of  occurrence  of  various  atmospheric  conditions 

3)  Less  reflection  of  solar  radiation  during  daytime  operation 
so  that  the  thermal  image  remains  reflectively  undiluted 
by  visible  scene  components  (Lloyd,  *1975a) 

Recently,  however,  a  shift  toward  the  3  to  5  pm  band  has  been  occurring 
♦Kruse,  1976).  Performance  evaluations  using  various  seasonal,  latitudinal, 
and  aerosol  models  available  in  Lowtran  III  transmission  model  and 
Radst  path  transmission  model  (Tuer,  1977)  have  indicated  that  the 
shorter  infrared  wavelengths  may  be  superior  to  those  in  the  longer  band 
under  certain  operational  conditions  (notably,  most  of  those  modeled  by 
the  Tropical  and  Midlatitude  Summer  models  for  ranges  up  to  20  km) 


5}c 

and  adequate  in  others  (the  winter  conditions  modeled).  The  shorter 
wavelength  band  also  is  used  when  background  uniformity  requirements 
have  discouraged  the  development  of  FLIR  systems  using  the  longer  wave¬ 
lengths  (Miller,  1973b). 

System  Factors 


The  purpose  of  an  infrared  system  is  to  respond  to  the  infrared  radiation 
that  is  transmitted  through  the  atmosphere  and  is  available  at  the  sensor. 
This  radiation  must  be  processed  so  that  it  can  be  displayed  to  and  used 
by  a  human  operator  whose  job  it  is  to  detect,  recognize,  and  identify  targets 
of  actual  or  potential  interest.  However,  in  order  to  effect  this  end,  a 
multi- component  system  is  required,  one  in  which  each  component  imposes 
its  own  limitations  upon  the  image  that  is  ultimately  displayed. 

.Although  FLIR  systems  differ  in  their  particulars  and  may  utilize  various 
component  architectures,  they  share  basic  features.  These  are  represented 
in  Figure  3.  Performance  constraints  are  imposed  by  each  of  the  sub¬ 
systems  represented:  optical,  scanning,  detector,  image  processing,  and 
display.  The  influence  of  each  of  these  on  system  performance  will  be 
discussed  separately/ 


However,  the  author  questions  the  adequacy  of  the  aerosol  model  used. 

^Except  where  otherwise  noted,  this  discussion  is  based  largely  on  two 
sources:  Lloyd  (1975b)  and  Sendall  and  Rosell  (1973). 


16 


Figure  3.  Simplified  Single-Detector  Dual-Axis  Scanner 
(Lloyd,  1975b,  p.  10.) 


Optics- -The  primary  purpose  of  the  FLIR  system's  optics  is  to  collect 
the  available  radiant  energy  and  focus  it  on  the  image  plane  composed  of 
detector  elements. 


Two  kinds  of  optical  systems  have  been  developed:  reflective  and  refractive. 
Lloyd  (1975b)  describes  the  relative  advantages  and  disadvantages  of  each 
in  the  following  paragraph: 

For  a  specific  lens  diameter  and  focal  length,  the  reflection 
and  absorption  losses  of  a  refractor  will  be  greater  than  the 
absorption  losses  of  a  reflector,  but  the  overall  collection 
efficiency  of  the  reflector  may  or  may  not  be  better  depending 
on  the  amount  of  central  obscuration.  A  reflector  tends  to  be 
lighter  in  weight  and  less  expensive  than  an  equivalently  sized 
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refractor  but  the  reflector  may  not  have  the  same  image 
quality.  For  example,  spherically- surfaced  reflectors  cannot 
be  corrected  for  off-axis  aberrations  without  use  of  a  refractive 
corrector  plate,  whereas  spherically- surfaced  refractors  facilitate 
aberration-balanced  optical  designs.  Since  spherical  surfaces 
are  less  expensive  to  produce  than  aspherics,  this  is  an  important 
consideration.  On  the  other  hand,  refractors  suffer  from  chromatic 
aberrations,  while  reflectors  do  not.  The  prevailing  bias  in 
FLIR  design  is  in  favor  of  refractive  systems  since  so  many  ingenious 
concepts  exist  which  enable  good  quality  to  be  achieved  in  a  compact 
package.  However,  the  cost  advantages  of  reflectors  make  it 
necessary  to  re-evaluate  that  bias  each  time  a  new  optical  system 
is  conceived  (p.  212). 


Because  most  FLIR  systems  use  refractive  optics,  this  review  deals 
exclusively  with  this  type.  And  since  the  expense  and  complexity  of 
fabricating  aspheric  lenses  have  led  to  the  use  of  spherical  and  flat  lens 
surfaces  in  most  FLIR  systems,  these  optics  are  stressed. 

For  simple  refractive  lens  systems,  the  parameters  of  primary  concern 
are  field  of  view,  the  effective  clear  aperture  diameter,  and  the  effective 
focal  length  of  the  lens  system.  The  field  of  view  of  an  optical  system  is 
the  amount  of  a  scene  that  is  optically  imaged  by  the  system.  It  is  characterized 
by  the  shape  and  angular  dimensions  of  the  cone  that  is  projected  from  the 
optics  onto  object  space.  Emitted  or  reflected  radiation  from  objects  within 
that  cone  is  imaged  by  the  system. 


It  should  be  noted  that  the  optical  field  of  view  need  not  be  the  same  as  the 
system’s  field  of  view.  System  field  of  view  will  also  depend  on  other  design^ 
considerations  such  as  scan  angles  and  what  portion  of  the  video  is  chosen 
for  display  (Lloyd,  1975b). 


The  effective  clear  aperture  diameter  defines  the  entrance  pupil  of  the  FLIR 
system,  unless  there  is  an  internal  F-sto  >.  If  the  latter  is  the  case,  then 
this  F-stop  determines  the  entrance  pupil.  In  either  case,  the  shape  and 
linear  dimensions  of  the  entrance  pupil  determine  the  region  over  which 
infrared  radiation  will  be  accepted  by  the  system. 

Finally,  the  focal  length  is  the  distance  from  the  lens  at  which  parallel  rays 
of  radiation  are  brought  into  focus.  When  the  focal  length  (f)  of  the  lens  is 
related  to  the  lens'  clear  aperture  diameter  (Dq),  one  obtains  an  index  of 
the  lens'  radiation  gathering  power  (the  F/No. ).  The  relevant  relationship 
is  stated  in  this  equation: 


F/No.  =  f/D 

o 

Expressed  in  this  way,  the  lower  the  F/No.  the  more  radiation  the  FLIR 
system  will  be  able  to  collect.  However,  infrared  technology  deviates  from 
the  traditional  practice  used  for  electro-optical  (TV)  devices;  it  does  not 
make  use  of  F/No.  as  a  basic  system  parameter.  Because  detectors  of 
virtually  any  size  are  available  and  because  system  sensitivity  is  a  function 
of  clear  aperture  diameter  and  the  system's  instantaneous  field  of  view, 
FLIR  system  performance  is  essentially  independent  of  F/No.  (Sendall  and 
Rosell,  1973).  As  Sendall  and  Rosell  (1973)  state. 


. . .  for  a  photon- limited  system,  either  the  instantaneous 
field  of  view  and  optics  pupil  or  the  F/No.  and  photo¬ 
receiver  diameter  can  be  considered  to  be  the  important 
parameters.  The  IR  (infrared  technology]  took  the  first 
two,  the  TV  took  the  second  two  (pp.  89-90). 
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Regardless  of  how  one  describes  the  radiation-gathering  power  of  a  FLIR 
system,  however,  that  power  does  represent  a  potential  fundamental  limita 
tion  of  the  system's  overall  performance  capabilities.  Optics  affect  FLIR 
system  performance  in  several  other  ways  as  well.  These  effects  can  be 
classified  according  to  their  sources: 

1)  Material  effects 

2)  Optical  effects  i  k 

3)  Architecture  effects 

The  effects  attributable  to  each  source  are  listed  in  Table  3. 


TABLE  3.  OPTICAL  SYSTEM  EFFECTS  THAT  INFLUENCE 
FLIR  SYSTEM  PERFORMANCE  : 


Source 

Effects 

Mai  crial 

Transmission  loss  (through  such 
things  as  reflection  and 
absorption) 

-  Thermal  expansions  and 
contractions:  change  of  lens 
parameters  that  are  attributable 
to  terrestrial  temperature 
changes 

Opl  ical 

-  Seidel  aberrations: 
spherical  aberrations, 
astigmatism,  field  curvature, 
distortion,  and  coma 

Chromatic  aberrations 

-  Focus  error,  blur,  and  off-axis 
degradation 

Architecture 

-  Cold  reflections 

Based  on  Lloyd,  1975b. 
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Faced  with  these  effects,  there  are  a  number  of  options  available  to  a  FLIR 

system  designer.  Some  of  the  material  effects  can  be  minimized  with  the 

* 

proper  selection  of  a  lens  material.  Others  that  arise  from  thermal 
defocussing  can  be  dealt  with  using  compensation  techniques  such  as  focus 
adjustments  (manual  or  automatic)  or  a-thermalizing  the  lens  through  lens 
construction  or  lens  mounting  design  (Lloyd,  1975b). 

The  optical  and  architecture  effects  may  be  minimized  through  other  system 
design  considerations.  For  example,  to  correct  for  field  curvatures  Lloyd 
suggests  the  following  possibilities:  ". . .  designing  the  optical  system  to 
have  a  flat  focal  surface,  fabricating  detectors  on  a  continuously  curving 
focal  plane  assembly,  or  constructing  the  array  of  flat  canted  segments. . .  " 
(Lloyd,  1975b,  p.  244).  To  correct  for  cold  reflections  he  suggests  five 
procedures 

1)  Reduce  the  focal  plane  effective  radiating  cold  area 
by  warm  baffling. 

2)  Reduce  lens  surface  reflections  by  using  high  efficiency 
antireflection  coatings. 

3)  Defocus  the  cold  return  by  designing  the  optical  system 
so  that  no  confocal  surfaces  are  present. 

4)  Cant  all  flat  windows. 


A  wide  range  of  optical  materials  is  available.  The  properties  of  some 
of  these  are  provided  by  Lloyd  (1975b,  Table  6.1,  pp.  258-259). 
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5)  When  all  else  fails,  null  out  the  cold  reflection  with  a 


thermal  source  or  by  electronic  video  signal  compensation 
( Lloyd,  1975,  p.  281). 

Unfortunately,  such  design  considerations  also  affect  system  complexity. 

Scanning  Mechanisms--The  image  formed  by  the  optical  system  constitutes 
the  stimulus  for  the  detector  system.  While  many  detector  array  designs 
exist,  most  do  not  have  the  detector  plane  positioned  at  the  image  plane. 
Instead,  FLIR  systems  usually  have  a  scanning  mechanism  that  moves  the 


Lloyd  adds  that  the  first  four  procedures,  in  combination,  are  usually 
adequate  to  correct  narcissus,  an  effect  that  arises  when  detectors  sense 
their  own  cold  surfaces  relative  to  their  warm  surrounding.  Narcissus 
occurs  when  detector  surfaces  are  reflected  onto  the  focal  plane  via  the 
optics  of  the  FLIR  system. 

Signal  dependent  and  signal  independent  shading  (broad,  slow- varying 
spurious  signals  superimposed  on  a  displayed  scene)  may  also  arise  from 
poor  optical  design  or  from  scanner-optics  configurations  (Lloyd,  1975b). 
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image  formed  by  the  optics  across  a  smaller  detector  plane  in  such  a  way 
that  the  detectors  completely  dissect  the  image. 

There  are  two  basic  kinds  of  scanning  mechanisms,  convergent  beam 
scanners  and  parallel  beam  scanners.  In  terms  of  system  design,  the 
primary  difference  between  them  is  the  placement  of  the  scanning  mechanism 
relative  to  the  optical  system.  A  convergent  beam  scanner  is  often  a  moving 
mirror  or  other  scanning  device  placed  between  the  inner- most  focussing 
element  of  the  optical  system  and  the  detector  array.  A  parallel  beam 


Non- mechanical  scanners  have  been  designed.  However,  compared  to  the 
worst  mechanical  scanners,  the  best  of  the  non- mechanical  devices  have  a 
thermal  sensitivity  and  spatial  resolution  that  is  worse  by  a  factor  of  two. 

[f  the  comparison  is  made  between  the  best  of  each  kind  of  device,  the  rela¬ 
tive  performance  of  non-mechanical  scanners  compared  with  their  mechanical 
counterparts  is  an  order  of  magnitude  worse. 

Lloyd  discusses  two  reasons  for  the  poor  relative  performance  of  non¬ 
mechanical  scanners: 

First,  if  detection  is  achieved  by  heating  of  the  sensing  material 
by  the  scene  radiation,  the  necessity  for  imaging  scene  motion 
without  smearing  requires  a  short  thermal  time  constant,  and  ttie 
resultant  high  thermal  diffusivity  gives  poor  resolution  due. to  irhage 
spreading.  Second,  if  the  device  is  electro-optical,  it  linearly 
converts  either  infrared  photons  or  power  into  either  photons  or 
electrical  signal.  The  resulting  image  contrasts  are  unacceptably 
poor  because  the  large  and  uninformative  thermal  background  has 
been  converted  to  the  visible  along  with  the  much  smaller  scene 
variations  riding  on  the  background  (Lloyd,  1975a,  p.  51). 

Although  Lloyd  projects  that  mechanical  devices  will  dominate  into  the 
mid-1980's,  he  adds  that  the  future  of  non-scanning  mechanisms  has  not 
been  foreclosed;  silicon  array  technology  may  yet  provide  feasible 
electronically  scanned  mosaics  of  detector  elements.  A  discussion  of  this 
technology  and  its  future  appears  later  in  this  review. 
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scanner,  by  contrast,  is  typically  an  optical  angle- changing  mechanism 
positioned  in  a  part  of  the  optical  system  where  rays  are  parallel  or 
collimated.  It,  too,  may  be  a  mirror  or  some  other  kind  of  device. 

Simplified  diagrams  of  each  kind  of  scanner  are  shown  in  Figure  4. 

Each  type  of  scanner  has  its  advantages  and  disadvantages.  For  example, 
while  convergent  beam  scanners  typically  need  fewer  optical  elements  than 
parallel  scanners,  they  introduce  aberrations  and  distortions  that  subsequently 
must  be  corrected.  On  the  other  hand,  while  parallel  beam  scanners  do 
require  more  complex  optics,  they  are  less  susceptible  to  image  quality 
loss  arising  from  any  non-flatness  of  the  scan  mirror  (Lloyd,  1975b), 


a.  Parallel  Beam  Scanner  b.  Convergent  Beam  Scanner 

Figure  4.  Designs  for  Two  Types  of  Common  Scanners 
(adapted  from  Lloyd,  1975b) 


There  are  seven  common  convergent  and  parallel  beam  scanners.  They 
can  be  organized  according  to  the  means  by  which  a  scan  is  effected.  This 
has  been  done  in  Table  4.  However,  taken  in  various  combinations,  a  wide 

variety  of  one-  and  two-dimensional  scanners  can  be  implemented.  Which 
mechanism  is  used  depends  upon  the  tradeoffs  that  are  of  concern  for  a 
particular  application.  Some  of  the  major  advantages  and  limitations  of 
several  of  these  systems  are  summarized  in  Table  5. 

Detector  Mechanisms- -The  purpose  of  a  detector  is  to  transduce  the  infrared 
radiation  into  some  kind  of  observable  form,  for  example,  an  electric  current, 
an  alteration  of  some  physical  property  of  a  detector,  or  a  blackening  of  an 
infrared  film  (Hudson  and  Hudson,  1975). 

Detectors- -Roughly  speaking,  detectors  can  be  classified  according  to 
the  hierarchical  scheme  shown  in  Figure  5. 


TABLE  4.  SCANNING  MECHANISMS  CLASSIFIED' 


MIRROR 

REFRACTION 

SENSOR 

Oscillating  mirror 

Polygonal  mirror 

Rotating  V-mirror 

Rotating  refractive  prism 

Rotating  wedge 

Revolving  lens 

Rotating  sensor 

Based  on  Lloyd,  1975b. 


TABLE  5.  ADVANTAGES  AND  LIMITATIONS  OF  VARIOUS  SCANNING 
MECHANISMS  GROUPED  BY  MECHANISM  TYPE 


[.  Oscillating  Mirrors:  1 

1. 

General:  not  suited  for  high  speed  scanning  since  they  become 
unstable  near  field  edges  and  demand  high  amounts  of  motor 
drive  power. 

2. 

Converging  beam  versions:  wave  changing  path  length /defocus 
problems  that  vary  as  a  function  of  scan  angle,  but  are 
correctable. 

3. 

Parallel  beam  versions:  (1)  require  that  the  scan  mirror  be 
located  near  the  exit  pupil  of  the  spread  of  the  scanned  beams, 
and,  thereby,  the  detector  lens,  are  to  be  kept  small,  and 
(2)  image  plane  motion,  detector  angular  subtense  and  scan 
angle  vary  as  a  function  of  the  systems  in- focus  range  since 
the  scanner  does  not  scan  a  parallel  beam  unless  the  object  is 
at  infinity. 

II.  Rotating  Reflective  Drum  Mirrors: 

1. 

Motion  is  continuous  and  stable. 

2. 

Scan  action  resembles  oscillating  mirror,  except  that  the 
centers  of  the  mirrors  that  make  up  the  polygonal  drum  move 
in  and  out.  This  leads  to  focal  point  changes  that  can  cause 
severe  defocusing  problems  in  convergent  beam  systems.* 
(Consequently,  this  design  is  most  often  used  in  parallel 
beam  systems). 

3. 

Interlacing  or  overscanning  is  achievable  by  varying  angular 
relations  among  the  drum's  adjacent  mirrors,  but  this  may  be 
accompanied  by,  or  at  least  susceptible  to,  image  rotation  and 
vignetting. 

4. 

Beam  shift  is  not  as  effectively  reduced  as  it  is  in  oscillating 
mirrors,  due  to  differences  between  facet  and  oscillating  mirror 
motions. 

5. 

Rotation  rate  is  potentially  limited  in  that  a  polygonal  mirror 
disintegrates  if  its  rotation  rate  exceeds  an  analytically  derivable 
maximum;  however,  before  this  rate  is  reached  facet  deformation 
imposes  a  practical  limitation  on  the  mirror's  usefulness. 
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TABLE  5.  ADVANTAGES  AND  LIMITATIONS  OF  VARIOUS  SCANNING 
MECHANISMS  GROUPED  BY  MECHANISM  TYPE*  (continued) 


6. 

The  drum  must  have  a  minimum  outer  radius  if  vignetting  is  not 
to  be  a  problem. 

1  III.  Rotating  Refractive  Prisms : 

1. 

Their  motion  is  continuous  and  typically  stable. 

2. 

In  converging  systems  this  mechanism  has  the  advantage  of 
permitting  in-line  design  that  uses  small  prisms. 

3. 

Interlacing  is  easily  achieved  by  canting  prism  faces. 

4. 

Prisms  are  subject  to  focal  length  shifts,  poor  scan  efficiency, 
and  optical  distortions:  aberrations  (spherical  and  chromatic), 
coma,  and  astigmatism. 

5. 

Refractive  materials  used  for  prisms  tend  to  have  high 
surface  reflection  losses.  (If  anti- reflection  coated,  efficiency 
may  be  reduced  for  large  incidence  angles,  thereby  leading  to 
even  higher  reflection  losses  at  prism  edges. ) 

6. 

Differences  between  scene  and  prism  temperatures  may  lead  to 
spurious  modulation  of  the  scene  image  due  to  prism  self¬ 
emissions  that  vary  as  a  function  of  scan  angle. 

IV.  Rotating  Refractive  Wedges: 

1. 

One  of  the  most  flexible  scanning  systems:  Varying  the  relative 
rates  of  rotation  of  two  wedges  can  result  in  a  variety  of  different 
scan  patterns. 

2. 

Must  be  used  in  a  parallel  system  since  severe  aberrations 
occur  in  a  converging  beam  system. 

3. 

Have  a  disadvantage  for  line  scanning:  Sinusoidal  scanning  leads 
to  lower  scan  efficiency  than  is  achievable  by  other  scanning 
designs. 

4. 

Frame-to-frame  and  line-to-line  registration  requires  tight 
control  of  wedge  angular  velocities. 

5. 

Gear  mechanisms  used  to  drive  wedges  are  subject  to  heavy  wear. 
Gear  backlash  has  also  been  a  problem. 
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TABLE  5.  ADVANTAGES  AND  LIMITATIONS  OF  VARIOUS  SCANNING 

MECHANISMS  GROUPED  BY  MECHANISM  TYPE"  (concluded) 


V.  Other  scanners: 

1.  Revolving  lens  scanners:  impractical  for  large  aperture 
systems  since  a  lot  of  glass  has  to  be  moved;  some  versions 
(for  example,  the  "spin-ball"  scanner)  have  low  scan  efficiency. 

2.  Circular  scanners  unlike  most  scanners- -which  generate  scans 
rectilinearly-- in  that  they  either  rotate  a  sensor  that  has  a 
radial  detector  array  or  rotate  the  scene  optically. 

a.  Rotating  sensor  scanners:  Have  the  disadvantages  of 

needing  to  rotate  a  large  sensor  mass  and  to  compensate 
for  the  associated  gyroscopic  effects. 

I).  Rotating  scene  scanners:  Have  the  advantage  of 
continuous  motion  and  the  optical  compensation  for 
image  rotation  that  might  occur. 


The  content  of  this  table  is  discussed  in  more  detail  and  treated  more 
analytically  in  Lloyd,  1975b. 

A  design  similar  to  the  polygonal  mirror  scanner  that  is  used  to  produce 
stable  scans  in  converging  beam  systems  is  known  as  the  "soupbowl.  "  It 
consists  of  a  circular-segment-raster  scanner. 


The  primary  distinction  between  thermal  and  photon  detectors  results  from 
the  fact  that  a  solid  may  be  treated  as  either  one  of  two  kinds  of  thermo¬ 
dynamic  systems,  a  lattice  or  an  electronic  system  (Hudson  and  Hudson, 
1975).  Thermal  detectors  depend  on  the  heating  of  the  detector's  lattice 
system.  This,  in  turn,  influences  the  detector's  electronic  system,  for 
example,  by  altering  its  resistance.  In  contrast,  photon  detectors  are 
designed  so  that  incident  radiation  interacts  directly  with  the  electronic 
system,  effecting  an  alteration  in  the  detector's  electronic  state. 


DETECTOR  TYPE 


THERMAL 


L 


EXTRINSIC 


PHOTON 


INTRINSIC 


r 


i 


PHOTOVOLTAIC 
MODE  OF 
OPERATION 


PHOTOCONDUCTIVE 
MODE  OF 
OPERATION 


Figure  5.  Classification  Scheme  for  Types  of 
Infrared  Sensitive  Detectors 

Depending  on  how  they  are  produced  and  the  nature  of  the  incident  photon 
interaction,  photon  detectors  may  be  one  of  two  kinds,  extrinsic  or  intrinsic. 
Extrinsic  detectors  are  crystalline,  but  crystals  into  which  impurities  have 
been  introduced.  Energy  from  incident  photons  is  used  to  liberate  electrons 
or  excite  charge  carriers  between  an  impurity  state  and  one  of  the  semi¬ 
conductor's  conduction  bands.  Intrinsic  detectors  are  also  crystalline,  but 
they  depend  upon  photon  energy  to  liberate  electrons  or  excite  charge 
carriers  between  valence  and  conductance  bands  of  the  semiconductors 
themselves  (Levinstein  and  IVludar,  1975;  Levinstein,  1977). 

Infrared  detectors  are  usually  operated  in  either  a  photoconductive  or  photo¬ 
voltaic  mode  (Levinstein,  1977).  In  the  case  of  intrinsic  photon  detectors, 
most  are  available  in  both  modes  (Levinstein  and  Mudar,  1975). 


The  photoeonductive  mode  requires  a  DC  power  source  which  is  connected 
to  a  load  resistance  and  to  the  detector.  Energy  induced  variations  in  the 
carrier  charge  concentration  alters  the  detector's  conductivity  and  thereby 
the  voltage  across  the  load  resistor.  Photovoltaic  operation  uses  p-n 
junctions  separating  charge  carriers  of  opposite  sign  as  a  built-in  battery. 
Consequently,  no  external  power  supply  is  needed.  Either  the  p  or  the  n 
region  of  a  junction  is  made  very  thin  so  that  photons  can  pass  through  it 
to  excite  the  charge  carriers  located  at  the  junction  (Levinstein  and  Mudar, 
1975;  Levinstein,  1977). 

Regardless  of  a  detector's  design,  detector  performance  is  typically 
characterized  in  terms  of  three  parameters:  spectral  response,  speed  of 
response,  and  signal- to-noise  ratio  per  watt  of  incident  power  (Corsi,  1975; 
Levinstein  and  Mudar,  1975;  Levinstein,  1977),  Each  of  these  parameters 
is  in  some  way  influenced  by  or  related  to  the  material  composition  of  the 
detector. 

Detector  spectral  response  is  directly  related  to  the  material  properties 
of  the  detector  and  is  the  parameter  that  most  clearly  distinguishes  between 
thermal  and  photon  detectors  (Levinstein  and  Mudar,  1975),  Although  thermal 
detectors  are  hypothetically  wavelength  invariant,  in  practice  not  ail  thermal 
detectors  have  the  same  spectral  response.  This  is  because  "...absorption 
by  the  sensing  layer  is  wavelength  dependent  and  since  the  energy  usually 


Corsi's  list  also  includes  operating  temperature.  Levinstein  and  Mudar 
augment  their  list  by  noting  the  following  factors,  viz.,  the  noise  spectrum, 
the  magnitude  of  the  signal  which  may  be  obtained,  the  saturation  and 
temperature  characteristics,  as  well  as  the  interrelations  of  these  and 
other  properties  (Levinstein  and  Mudar,  1975,  p.  6). 
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passes  through  a  protective  'window'  which  will  have  its  own  characteristic 
absorption"  (Levinstein  and  Mudar,  1975,  p.  6). 


The  spectral  response  of  photon  detectors  is  limited  by  a  somewhat 
different  set  of  theoretical  and  practical  considerations.  Because  energy 
is  inversely  related  to  wavelength,  there  is  a  long  wavelength  cutoff  for 
each  kind  of  detector  beyond  which  photons  do  not  have  enough  energy  to 
alter  the  detector's  electronic  structure  (Hudson  and  Hudson,  1975; 

Levinstein  and  Mudar,  1975).  This  cutoff  depends  on  a  variety  of  material 
factors,  such  as  element  temperature,  sample  purity,  and,  in  the  case  of 
ternary  compounds,  material  composition.  Furthermore,  in  actual  operation 
such  things  as  element  thickness  and  surface  preparation  affect  performance. 
But,  aside  from  aging,  once  the  detector  is  constructed  the  shape  of  the 
spectral  response  at  the  selected  operating  temperature  usually  stays 
constant  (Levinstein  and  Mudar,  1975).  The  spectral  response  characteris¬ 
tics  for  several  detectors  are  shown  in  Figure  6. 

A  detector's  speed  of  response  is  a  measure  of  its  ability  to  respond  to 
temporal  variations  in  the  incident  radiation.  In  thermal  detectors  the 
speed  of  response  depends  upon  how  quickly  the  detector's  heat- sensitive 
element  heats  and  cools;  this,  in  turn,  depends  upon  the  detector's  thermal 
capacity  and  its  contact  with  the  environment. 


Because  decay  is  usually  not  exponential,  the  speed  of  response  time  con¬ 
stants  are  often  measured  in  terms  of  the  time  it  takes  for  a  signal  to  drop 
from  90%  to  10%  of  its  illuminated  value  (Levinstein,  1977).  See  Levinstein 
and  Mudar  (1975)  for  a  description  of  this  and  an  alternative  measurement 
technique. 
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Figure  6.  Useful  Spectral  Ranges  for  Infrared  Detectors  (operating 
temperature  of  all  detectors  is  300  K  unless  noted) 

(Hudson  and  Hudson,  1975,  p.  107) 

The  speed  of  response  of  a  photon  detector  is  determined  by  the  length  of 
time  that  a  charge  carrier  remains  mobile  after  it  has  been  excited.  It  is 
also  a  function  of  the  number  of  recombination  centers  that  there  are  and 
their  capture  cross-section  (Levinstein  and  Mudar,  1975;  Levinstein,  1977). 

Today  detectors  are  capable  of  achieving  speeds  of  response  measurable  in 
nanoseconds.  However,  for  a  particular  detector,  speed  of  response  may 
depend  on  detector  temperature,  amount  of  incident  background  radiation, 
and,  for  some  detectors,  the  spectral  composition  of  the  background 
radiation.  On  the  other  hand,  the  variability  of  the  response  depends  on  the 
complexity  of  the  recombination  process  (Levinstein,  1977). 
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The  detectivity  of  a  detector  is  the  minimum  power  to  which  the  detector 
will  respond.  It  is  defined  by  the  relation: 


D  =  <2M 

EA 


where  D  is  detector  detectivity,  S  is  the  signal  voltage,  N  is  the  noise 
voltage,  E  is  the  signal  root  mean  square  power  density  (irradiance)  at  the 
detector,  and  A  is  the  detector's  area  (Levinstein  and  Mudar,  1975). 
Because  noise  is  a  function  of  amplifier  bandwidth  (if)  and  detector  area, 
detector  detectivity  is  usually  reported  as  a  normalized  quantity: 


(S/N)  (Af)1/2 

172“ 


E(A)' 


The  higher  the  D  value,  the  smaller  the  amount  of  radiation  that  the 
detector  detects.  Notice,  however,  that  the  normalized  D  involves  two 

1/2  i /? 

assumptions,  that  detector  noise  is  a  function  of  A  and  of  (if).  -  Those 

assumptions  are  not  always  correct.  Therefore,  the  significance  of 
particular  D  values  must  be  interpreted  cautiously  (Levinstein  and  Mudar, 
1975;  Levinstein,  1977)/ 


A  detector  with  1  cm  area  and  amplifiers  of  1  Hz  bandwidth  is  used  as 
the  detector  to  which  the  other  detectors  are  normalized. 


Levinstein  and  Mudar  (1975)  note: 

The  first  assumption  is  valid  for  photon  detectors  as  long  as  detector 
areas  do  not  vary  by  more  than  an  order  of  magnitude.  It  may  not  be 
valid  at  all  for  certain  thermal  detectors.  The  second  assumption 
requires  that  noise  is  frequency  invariant  over  the  amplifier  bandwidth 
or  that  it  is  measured  over  such  a  narrow  band  that  its  variation  is 
insignificant  (p.  7). 
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Once  a  detector's  spectral  response  and  D  are  known,  : ,  the  detectivity 
of  the  detector  for  a  given  wavelength,  can  be  evaluated  and  its  theoretical 
limit  calculated  (see,  for  example.  Figure  8,  discussed  below).  The  best 
modern  detectors  achieve  within  10%-20%  of  this  limit  while  the  average 
detector  attains  within  50%  of  this  figure  (Levinstein  and  Mudar,  1975; 
Levinstein,  1977).  Some  typical  spectral  response  curves  for  detectors 
operating  at  near-optimum  temperatures  are  shown  in  Figures  7a  and  7b. 

There  are  several  noise  sources  that  can  potentially  limit  a  photon  detector's 
responsiveness:  Johnson  noise  (noise  attributable  to  the  random  motion  of 
charge  carriers),  1/f  noise  (noise  whose  power  varies  inversely  with  wave¬ 
length  and  has  a  variety  of  causes),  and  GR  noise  (noise  arising  from 
generation  and  recombination  of  charge  carriers).  In  semiconductors, 
Johnson  noise  is  negligible  compared  with  the  other  noise  sources,  and  1/f 
noise  is  controllable,  through  production,  above  100  Hz  and  often  above  20 
Hz.  Thus  the  limiting  source  of  noise  is  GR  noise. 

GR  noise  is  attributable  to  thermal  generation  of  the  charge  carriers  due  to 
lattice  vibration.  To  minimize  the  effects  of  GR  noise,  detectors  are  usually 
cooled  to  a  point  where  either  the  effects  of  this  noise  become  negligible  or 
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b.  Intrinsic  and  Various  Doped  Ge  Extrinsic  Detectors 

(curves  compare  spectral  response  for  the  materials  and 
temperatures  shown) 

Figure  7.  Spectral  D  ’  for  Various  Intrinsic  and  Extrinsic  Detectors  Operating 
at  Near-Optimum  Temperatures  (adapted  from  Levinstein,  1977) 
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no  further  improvement  is  possible.  At  this  point,  the  detector  is  said  to 
he  background  limited. 


An  ideal  detector,  under  these  conditions,  is  referred  to  as  a  background- 
limited  infrared  photoconductor  (BLIP)  and  the  operation  of  the  detector  is 
referred  to  as  BLIP  operation.  For  BLIPS,  noise  from  the  background  is 
the  performance-limiting  factor  (Corsi,  1975)  and  spectral  detectivity  is 
given  by  the  following  expression: 


where  h  is  Planck's  constant,  c  is  the  speed  of  light,  H  is  the  detector's 
quantum  efficiency  (assumed  constant  with  X),  and  Q  is  the  photon  flux 

D  • 

from  the  background.  For  a  given  locale,  such  as  Central  Europe,  Q 

B 


Hudson  and  Hudson  (1975)  note  that. 

In  general,  thermal  detectors  can  be  operated  without  cooling, 
respond  over  large  portions  of  the  spectrum,  have  lower  values 
of  D  than  photon  detectors,  and  exhibit  relatively  long  response 
times  so  that  they  are  not  well  suited  for  high-information-rate 
systems.  Photon  detectors,  by  comparison,  generally  require 
cooling  for  operation  beyond  3  jam,  respond  over  relatively 
narrow  portions  of  the  spectrum,  have  values  of  D  that  are 
one  or  two  orders  of  magnitude  higher  than  those  of  thermal 
detectors,  and  exhibit  very  short  response  times  so  that  they 
are  well  suited  for  use  in  high- information- rate  systems  (p.  107). 

For  those  detectors  that  do  require  cooling,  the  longer  the  wavelength  that 
is  to  be  detected,  the  more  cooling  required.  Thus,  3  ^m  detectors  with  a 
180u  field  of  view  operating  at  300K  need  no  cooling,  while  3  /urn  to  12  ^m 
detectors  need  to  be  cooled  from  dry  ice  to  liquid  nitrogen  temperatures. 
Longer  wavelength  detectors  must  be  cooled  to  even  lower  cryogenic 
temperatures.  For  example,  liquid  helium  temperatures  are  necessary  for 
detectors  responding  to  wavelengths  exceeding  the  20  /urn  to  30  ^m  range 
(Levinstein  and  Mudar,  1975). 
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can  be  determined  from  knowing  the  background  temperature  and  the 
detector's  field  of  view.  For  analytic  purposes,  T]  is  assumed  to  be  1. 
Thus,  for  a  given  detector,  with  a  given  field  of  view,  detectivities  of  a 
BLIP  detector  are  a  function  only  of  the  spectral  composition  of  the  back¬ 
ground  and  the  long  wavelength  cutoff  of  the  detector. 

Figure  8  shows  the  spectral  D  for  a  BLIP  detector  having  various  fields 
of  view.  Actual  performance  is  somewhat  lower  since  not  all  sources  of 
noise  (such  as  1/f  noise)  may  be  eliminated  and  because  quantum  efficiency 
usually  is  not  1,  since  not  all  incident  photons  are  absorbed  (Levinstein  and 
Mudar,  1975). 

Because  depends  upon  the  detector's  angular  field  of  view  and  back¬ 
ground  radiation,  it  can  be  increased  by  using  cold  apertures  to  reduce  the 
field  of  view  or  by  filtering  the  spectral  band  passed  by  the  detector.  How¬ 
ever,  there  are  some  fundamental  tradeoffs  involved.  As  Levinstein  (1977) 
observes: 

A  reduction  in  background  radiation. .  .usually  requires  additional 
detector  cooling  for  the  number  of  thermally  excited  charge  carriers 
to  remain  negligible.  Furthermore,  such  a  reduction  in  background 
will  lengthen  the  time  constant  and,  if  filtering  is  improperly  done, 
it  may  reduce  radiation  from  the  source  (p.  25). 

The  performance  characteristics  of  various  kinds  of  detectors  are  summa¬ 
rized  in  T able  6. 


Also,  Levinstein  (1977)  notes  that: 

For  photovoltaic  detectors  D^:<  is  greater  by  / 2~ than  for  the 
equivalent  photoconductive  detector,  because  one  need  consider 
only  noise  produced  by  the  generation  of  charge  carriers  but  not 
by  their  recombination  (p.  2  5). 
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Figure  8.  Background- Limited  Detectivity  at  Spectral  Peak  as  a  Function  of 

Long- Wavelength  Threshold  (adapted  from  Levinstein,  1977,  p.  25.) 


TABLE  6.  CHARACTERISTICS  OF  TYPICAL  PHOTON  DETECTORS 


Material 

Operal  inp 

T  omporulnro 
<K> 

Peak 

\\  avelenRth 
(K) 

)  ’oak  1  )oUcti  vil  v  1 ) 
(cm  11/'  watt"  ^ ) 

T imr  (  onst.ml 
(its) 

PliS  (F) 

too 

2.  r> 

id11 

too 

PbSc  (F) 

2  00 

4.  it 

2  x  1010 

20 

tnSb  (PV) 

!!0 

•r),0 

ion 

0.  2 

( ;i‘:  \u 

no 

a.  0 

1010 

0.  001 -0.  1 

(..■dip 

!0 

10 

lo'° 

0.  0002-0. 1 

t  ;<■:(  u 

A 

20 

2  x  lo'° 

0.  01 -0.  1 

PI  SnTe  (PV) 

C.O 

l  1 

1-2  X  1010 

1  x  1010 

-  1 

-  0.  01 

HitCdTc  (PC) 

ilO 

1 1 

1-2  x  1010 

~0.  5 

Field  of  view  if  lflO  in  eacli  case. 
F  *  Film 

PV  *  Photovoltaic  mode 
PC  *  Pholocondnctive  mode 


Adapted  from  l.evinstein.  1077. 
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Detector  Arrays — In  common  practice,  FLER  systems  do  not  use  single 
element  detectors.  Rather,  the  per  frame  and  the  per  resolution  element 
signal-to-noise  ratios  are  increased  by  increasing  the  number  of  detectors 
that  are  used  to  dissect  the  scene.  The  direct  result  is  the  enhancement  of 
the  FLIR  system's  sensitivity  (Lloyd,  1975b). 


Detector  array  architectures  vary  depending  on  how  the  scene  is  dissected. 

The  two  common  architectures  currently  in  use  are  parallel  and  serial  arrays. 

In  parallel  scene  dissection,  an  array  of  detectors  is  oriented 
perpendicular  to  the  primary  scan  axis,  as  in  a  unidimensional 
detector  array  used  with  an  azimuth  scanner.  All  of  the  detector 
outputs  are  amplified,  processed  and  displayed  simultaneously  or 
in  parallel.  In  serial  scene  dissection,  an  array  of  detectors 
is  oriented  parallel  to  the  primary  scan  axis  and  each  point  of  the 
image  is  scanned  by  all  detectors.  The  detector  outputs  are 
appropriately  delayed  and  summed  by  an  integrating  delay  line 
which  superimposes  the  outputs,  thereby  simulating  a  single 
scanning  detector,  or  they  may  be  read  out  one-for-one  on  a 
similar  array  of  scanning  display  elements  (Lloyd,  1975b,  p.  330). 


When  the  two  modes  of  scene  dissection  are  compared,  each  has  its 
relative  advantages  and  disadvantages.  These  are  summarized  in  Table  7. 


In  assessing  the  performance  of  these  alternative  designs,  Lloyd  (1975b)  is 
personally  predisposed  toward  the  serial  array  concept.  In  support  of  his 
bias,  he  makes  the  following  two  points:  (1)  given  current  technology  and 
system  design  considerations,  when  compared  with  parallel  systems,  serial 
systems  attain  a  given  level  of  performance  using  a  fewer  number  of 
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TABLE  7.  RELATIVE  ADVANTAGES  AND  DISADVANTAGES  OF 
SERIAL  AND  PARALLEL  SCENE  DISSECTION* 


PARALLEL  DISSECTION  ) 

Advantages 

Disadvantages 

Electronic  bandwidth  require¬ 

1. 

More  complex  processing  is 

ments  per  channel  are  mini¬ 

required  for  response 

mized  and  optical  signal 

equalization  and  DC 

processing  becomes  possible 

restoration  due  to  the  large 

(Sendall  and  Rosell,  1973). 

number  of  independent 
detectors. 

Simpler  scanning  mechanisms 

are  required. 

2. 

There  is  greater  potential 
for  image  nonuniformities 

Slower  scan  rates  are 

attributable  to  (1)  in- 

possible  (Sendall  and 

transic  detector  detectivity 

Rosell,  1973). 

and  responsivity  differences 
and  (2)  AC  coupling 

Longer  dwell  times  improve 

artifacts  arising  from 

sensor  sensitivity. 

different  average  scene 
values  generated  by 
different  detectors  (Lloyd, 

1975b). 

_ _ 

3. 

The  potential  for  information 
loss  from  malfunctioning 
or  broken  detector(s)  is 
greater. 

SERIAL  DISSECTION1 

Advantages 

Disadvantages 

Integration  of  several 

1. 

More  complex  processing  is 

detectors  increases  the 

required  for  signal  integra¬ 

effective  sensor 

tion  (for  example,  time- 

performance. 

delay-and-add  processing 
call  for  the  implementation 

The  system  is  relatively 

of  delay  lines). 

simpler  because  respon- 

sivity  equalization  and 

2. 

The  system  require  more  com¬ 

DC  restoration  are  easily 

plex  optics  since  di  lion 

accomplished. 

requires  a  parallel  uu.n 
scanner  (Lloyd,  1975b). 

Image  nonuniformities  do  not 
occur  because  the  different 

3. 

Scanners  are  more  complex. 

detectors'  outputs  are 
integrated  (Lloyd,  1975b). 


3.  Scanners  are  more  complex. 


TABLE  7.  RELATIVE  ADVANTAGES  AND  DISADVANTAGES  OF  SERIAL 
AND  PARALLEL  SCENE  DISSECTION*  (concluded) 


SERIAL  DISSECTION1  (concluded) 


Advantages 

Disadvantages 

4.  There  is  less  low-frequency 
undershoot  of  hot  targets, 
because  of  shorter  dwell  times. 

4.  Wider  bandwidth  detectors 
are  needed,  due  to  shorter 
dwell  times.6 

Unless  otherwise  noted,  material  for  this  table  was  taken  from 
Mortensen  (1978).  Aspects  of  the  material  will  be  discussed  in  more 
detail  below. 

Serial- parallel  systems  have  also  been*  developed.  These  are  essentially 
serial  devices  that  scan  more  than  one  line  at  a  time.  The  additional  lines 
are  time  delayed  for  insertion  into  the  output  at  the  appropriate  time.  Such 
a  system  improves  the  system's  sensitivity  by  allowing  slower  scan  rates. 
However,  this  is  at  the  expense  of  increased  delay  and  multiplexing  electronics. 
"Staring"  arrays,  which  substitute  electronic  for  mechanieal  scanning,  are 
also  under  development  (Mortensen,  1979).  These  staring  sensors  will  be 
discussed  briefly  below. 

^If  the  single  detector  gains  are  optimized,  the  effective  signal- to- noise 
ratio,  as  given  by  Lloyd  (1975b),  is  the  root  sum  squared  value  of  the 
individual  detector  signal- to- noise  ratios.  The  effective  detectivity  is  then: 


where  D  *  is  the  effective  detectivity,  n  is  the  number  of  detectors  and 
D^*  is  a  detectivity  for  a  particular  detector.  Note;  This  assumes  equal 
detector  responsivity. 

6 

Sendall  and  Rosell  (1973)  state  that 

The  disadvantages  of  the  system  are  that  the  large  bandwidth 
required  right  out  of  the  detector  pushes  the  present  state  of 
the  art  limiting  the  number  of  picture  elements  per  second 
and  precluding  effective  scan  overlap  leaving  the  data  sample 
data  limited  in  one  direction.  Also  the  scan  speeds  required 
are  a  mechanical  design  burden  (p.  112). 


detectors;  (2)  serial  systems  provide  an  image  which  is  subjectively  better 

>jc 

than  that  provided  by  parallel  systems. 

Nevertheless,  the  development  possibilities  of  serial  and  parallel  are 
limited.  In  order  to  increase  sensitivity,  larger  arrays  than  are  presently 
used  have  been  sought.  But  there  are  practical  considerations  that  restrict 
the  simple  enlargement  of  existing  architectures.  These  have  to  do  with 
the  cooling  and  image  processing  complexities  which  are  introduced  (Lloyd, 
1975b;  Levinstein,  1977).  However,  there  have  been  a  number  of  recent 
advances  in  charge- coupled  devices  (CCDs)  and  charge- injected  devices 
(CIDs).  (See,  for  example,  Barbe,  1976;  Bower,  1978;  Hirshberg,  1975; 
Lewis,  1978;  Sachs,  1975,  1978;  and  Savoye,  1978.)  These  advances  have 
led  to  interest  in  the  military  applicability  of  charge- coupled  and  charge- 
injected  devices  (Barbe,  1976;  Bower,  1978;  Hirshberg,  1975),  as  is  shown 
in  Table  8.  Most  of  the  interest,  however,  seems  to  have  focused  upon 
developing  CCD  technology  for  the  3  to  5  /jm  infrared  range.  Therefore, 
even  though  most  of  this  technology  currently  exists  only  for  the  visible  and 
near-infrared  range  (Barbe,  1976;  Bower,  1978)  it  will  be  discussed  briefly 
below. 

Charge- coupled  devices  are  silicon  semiconductors  that  are  capable  of 
image  sensing,  analog  signal  processing,  and  digital  or  analog  memory 

jjc 

Unless  an  automatic  responsivity  control  is  incorporated  into  a  parallel 
system,  image  nonuniformities  (from  detector  detectivity  and  responsivity 
differences)  degrade  image  quality.  On  the  other  hand,  if  an  automatic 
responsivity  control  is  used,  then  line-to-line  detector  noise  differences 
are  exaggerated.  The  nonuniformity  problems  are  not  found  in  a  serial 
system  because  of  the  integration  processes  used  (Lloyd,  1975b). 


TABLE  8.  CCD  AND  CID  MILITARY  APPLICATIONS* 


Mode  of 

Operation 

Application 

Important 

Characteristics 

Integrating  + 

Missile  guidance 

Sensitivity 

Ruggedness 

High  frequency 
Metricity 

Light  weight 

Artillery  TV 

Ruggedness 

Small  size 

Day/night  ground- 
based  surveillance 

Sensitivity 

High  resolution 

Time  Delay 

Satellite  surveillance 

Sensitivity 

High  resolution 

Low  power 

Small  size 

Light  weight 

and  * 
Integration' 

E-O  day/  night 
periscope 

Sensitivity 

High  resolution 

Low  voltage 

Small  size 

Remote  piloted 
vehicles 

Sensitivity 

High  resolution 

Low  power 

Small  size 

Light  weight 

*Ba rbe,  1976,  p.  112. 


Integrating  arrays  look  at  a  scene  for  a  period  of  time  to  integrate  a  frame 
of  video  information.  (This  note  is  based  on  Barbe  (1976)  but  was  not  part  of 
table. ) 

^  Time  delay  and  integration  arrays  are  M  x  N  cell  arrays  that  shift  charges 
along  the  M  columns  at  the  same  rate  that  the  scene  is  being  scanned.  Because 
of  this,  integration  time  is  increased  by  a  factor  M  and  the  signal-to-noise  ratio 
improved  by  a  factor  of  M;  or  M  without  a  loss  of  resolution.  (Because  of  a 
tradeoff  between  signal-to-noise  ratio  and  resolution,  signal  improvement 
occurs  at  the  expense  of  resolution  when  a  linear  array  is  used  in  a  parallel 
scan  mode  of  operation.  Barbe  notes  that: 

The  ability  of  the  CCD  to  perform  TD1  is  very  important  for 
imaging  systems  applications  where  mechanical  scan  is  provided 
in  one  direction  and  where  the  light  level  is  very  low.  The 
ability  to  perform  TDI  is  also  useful  in  infrared  imaging 
applications.  (1976,  p.  113) 

This  note  is  based  on  Barbe  (1976)  but  was  not  part  of  table. 


(Bower,  1978).  When  used  as  image  sensors,  CCDs  take  advantage  of  the 

photoelectric  and  shift  register  properties  of  these  semiconductors.  Their 

operation  is  described  in  the  following: 

Absorption  of  .  .  .  incident  radiation  [ranging  from  400  to 
1100  nanometers]  in  the  silicon  generates  a  linearly 
proportional  number  of  free  electrons  in  the  specific  area 
illuminated.  If  a  silicon  device  structure  having  a  repetitive 
pattern  of  small  but  finite  photo-sensing  sites  is  created,  the 
number  of  free  electrons  generated  in  each  site  (charge -packet) 
will  be  directly  proportional  to  the  incident  radiation  on  that 
specific  site.  If  the  pattern  of  incident  radiation  intensity  is 
a  focused  light  image  from  an  optical  system  viewing  a  scene, 
the  charge-packets  created  in  the  finite  photo-sites  array  will 
be  a  faithful  reproduction  of  the  scene  projected  on  its  surface. 

After  an  appropriate  exposure  time,  during  which  the  incident 
light  on  each  site  is  generating  its  time  and  intensity  proportion¬ 
al  electron  charge -packet,  the  charge- packets  are  simultaneous¬ 
ly  transferred  by  charge -coupling  under  an  adjacent  single  long 
gate-electrode  to  a  parallel  CCD  analog  transport  shift  register.  .  . 

Each  charge-packet  corresponds  to  a  picture  element  (pixel) 
and,  when  transferred  to  the  adjacent  CCD  transport  shift 
register,  continues  to  faithfully  represent  the  total  sensed 
radiant  energy  which  was  absorbed  in  the  specific  photo  site. 

The  transfer  gate  is  immediately  returned  to  the  non-transfer 
clock  level  (LOW)  so  photo-sites  can  begin  integrating  the  next 
line  of  incident  image  information.  At  the  same  time,  the  CCD 
analog  transport  register  now  loaded  with  a  parallel-transferred 
line  of  picture  information  in  the  form  of  charge -packets  from 
a  line  of  sensor  sites,  is  rapidly  clocked  to  deliver  the  picture 
information  in  serial  format,  to  the  device  output  circuitry. 

(Bower,  1978,  pp.  17,  28) 

The  general  characteristics  of  CCDs  are  summarized  in  Table  9. 
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_ TABLE  9.  CHARACTERISTICS  OF  CCDs* _ 

TEMPERATURE 

1.  Works  best  at  low  temperatures  (-55°C)  but  can  perform  at  full 
capability  at  +70°C. 

2.  Cooling  is  relatively  simple. 

DYNAMIC  RANGE 

1.  Operation  achievable  with  cooling:  10,000:1. 

2.  Common  operation  at  room  temperature:  from  200:1  to  500:1. 

SPEED 

1.  Theoretically,  speed  limitation  is  set  by  electron  mobility. 

2.  Practical  speed  limits  are  a  result  of  ".  .  .  edge- dependent 
charging  current  associated  with  delivering  the  clock  voltages 

to  the  capacitances  of  the  shift- register  gate  electrodes  (C  dv/dt 
current),  "  (Bower,  1978,  p.  29), 

3.  Because  surface-state  trapping  slows  the  overall  mobility  of 
surface  carriers,  buried  channel  devices  are  faster  than  surface 
channel  devices.^ 

NOISE 

1.  The  basic  CCD  register  is  practically  noiseless  since  it  does 
not  have  p-n  junctions. 

2.  Some  noise  is  introduced  by  on-chip  charge  detectors  and 
buffer  amplifiers  that  do  have  p-n  junctions. 

RADIATION  HARDNESS 

1.  Basically  not  "hard".  (That  is,  they  can  be  altered  by  radiation.  ) 

2.  Buried  channel  devices  are  reported  to  be  more  radiation-tolerant 
than  surface  channel  devices. 
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TABLE  9.  CHARACTERISTICS  OF  CCDs"  (concluded) 

PACKING  DENSITY 

Storage  elements  may  be  packed  three  to  five  times  more  densely  in 
CCDs  than  in  the  next  most  dense  MOS  large-scale  integrated  circuits. 

OTHER  CONSIDERATIONS 

1.  CCDs  require  low  voltage  and  consume  little  power. 

2.  CCD  image  sensors  do  not  exhibit  lag  or  memory. 

3.  Although  sensors  might  oversaturate  and  "bloom”  under  intense 
illumination,  they  arc  not  damaged  by  it. 

Based  on  Rower,  1978. 

fTlie  difference  between  surface-channel  and  buried-channel  devices 
_ is  described  below. 

There  are  two  important  design  considerations  for  CCDs: 

1.  The  proximity  of  the  carrier  "channels”  relative  to  the 
semiconductor- insulator  interface,  and 

2.  The  mode  of  information  transfer  (Barbe,  1976). 


The  carrier  channels  can  be  buried  or  on  the  surface  of  the  interface.  If 
they  are  buried,  the  charge  packets  do  not  interact  with  the  interface  states. 
Buried-channel  and  surface-channel  CCDs  are  compared  in  Table  10.  Barbe 
(1976)  concludes  that; 

BCCD's  are  superior  to  SCCD's  in  terms  of  temporal  noise, 
spatial  noise,  and  speed.  However  SCCD's  have  the  advantage 
in  terms  of  fabrication  simplicity  and  lower  theoretical  dark 
current  (p.  113). 
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TABLE  10.  SURFACE  CHANNEL  BURIED  CHANNEL  COMPARISONS* 


SURFACE  CHANNEL 

BURIED  CHANNEL 

Limiting  Surface  trapping, 

temporal  hundreds  of 

noise  electrons 

Bulk  trapping, 
signal  level 
dependent,  tens 
of  electrons  ai 
low-signal  levels 

Limiting  Nonuniform  back- 

pattern  ground  charge 

"noise" 

Hundreds  of 
electrons 

Nonuniform  dark 
current  density, 
highly  dependent 
on  temperature, 
several  electrons 
at  -20'C 

Detectivity  Hundreds  of 

limit  electrons 

Tens  of  electrons, 
low- light  level 
solid-statd 
imaging  possible 

Speed  <  10  MHz 

limit3 

2  5  MHz  for  shallow 
buried  channels 

g 

Assuming  standard  photolithographic  design  rules 
Barbe,  1976.  p.  110. 

Information  transfer  can  be  effected  through  either  of  two  designs:  interline 
transfer  (IT)  or  frame  transfer  (FT).  The  tradeoffs  involved  in  each  are 
shown  in  Table  11,  along  with  a  comparable  CID  area  array  design. 


Barbe  (1976)  notes  that; 

The  primary  advantages  of  the  FT  CCD  area  array  organization 
are  1)  versatility  and  2)  high  sensitivity  in  the  backside  illuminated 
mode.  The  primary  advantage  of  the  IT  CCD  area  array  organization 
is  its  response  to  high-spatial  frequencies.  The  primary  advantage 
of  the  epi-CID  area  array  organization  is  its  excellent  anti-blooming 
control  (p.  113). 
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With  2:1  vertical  interlacing 
Barbe.  1976,  p,  110. 


■ 


Signal  Processing- -Detectors  respond  to  radiation  emitted  or  reflected 
from  two  sources:  targets  of  interest  and  the  background.  Signal  processing 
is  used  to  enhance  the  prominence  of  target-produced  signals  relative  to 
those  that  have  the  background  as  their  source. 

A  basic  processing  approach  has  been  to  isolate  the  target  signals  bv 
removing  the  background-produced  signals.  This  is  commonly  achieved  by 
means  of  amplifying  electronics  that  use  AC  coupling  (as  implemented,  for 
example,  in  a  RC  high-pass  circuit).  Such  circuitry  approximates  back¬ 
ground  subtraction  and  thereby  improves  the  relative  target-to-background 
contrast.  It  also  achieves  two  other  desirable  ends,  removing  whatever 
DC  biasing  potential  exists  on  a  detector  and  minimizing  the  effects  of  a 
detector's  1/f  noise  (Lloyd,  1975b). 

I’nt'ortunately,  however,  AC  coupling  has  undesirable  effects  on  image 
quality;  most  of  these  stem  from  the  fact  that  AC  coupling  entails  that  the 
average  output  value  of  the  circuit  be  zero.  This  means  that  if  a  detector 
outputs  a  positive  signal  in  response  to  a  very  hot  target,  then  given  the 
response  characteristics  of  the  system,  that  signal  will  be  followed  by  a 
lower  amplitude  negative  signal  of  longer  duration.  In  this  way  the  average 
output  of  zero  is  attained;  however,  it  is  at  the  risk  of  what  is  referred  to 
as  "DC  droop"  (Lloyd,  1975b),  the  effect  of  which  is  shown  in  Figure  9.  As 
Lloyd  notes,  "Clearly  any  low  frequency  elements  of  the  scene  will  suffer 
from  DC  droop  and  cause  undershoot  whenever  this  circuit  is  used"  (1975b, 
p.  341). 


Zero  represents  the  value  of  the  background,  once  it  is  subtracted.  The 
fluctuations  around  it,  therefore,  represent  the  potential  targets  of  interest. 
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TARGET 


Figure  9.  Appearance  of  Extreme  DC  Droop  (Lloyd,  1975b,  p.  342) 


When  the  effects  of  unidirectional  or  bidirectional  scan  are  taken  into 
account,  ihe  image  degradation  becomes  even  more  pronounced,  as  is  shown 
in  Figure  10,  Moreover,  it  becomes  a  particularly  bad  problem  in  multiple- 
channel  systems  where  different  channels  may  have  different  response 
histories.  In  such  cases,  channels  that  view  the  same  target  against 
different  backgrounds  may  produce  different  outputs  in  response  to  it  (Lloyd, 
1975b).  This  further  distorts  the  target's  appearance  when  it  is  ultimately 
displayed. 

Because  of  the  tradeoffs  involved  there  is  no  single  solution  for  these 
problems.  Lloyd  (1975b)  puts  the  problem  this  way: 

DC  droop  can  be  eliminated  by  reducing  the  time  constant,  but 

this  increases  the  duration  of  the  undershoot.  Undershoot  can  be 
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TARGET 


IMAGE  WITH  UNIDIRECTIONAL 
SCAN 


IMAGE  WITH  BIDIRECTIONAL 
SCAN 


Figure  10.  Effects  of  DC  Droop  with  a  Small  Hot  Source  in 

Unidirectionaliy  and  Bidirectionally  Scanned  Systems 
(Lloyd.  1975b,  p.  343) 

cured  by  increasing  the  time  constant,  but  this  increases  droop. 

Channel  responses  can  be  made  more  uniform  by  DC  coupling, 
but  this  complicates  detector  biasing  and  reduces  contrasts  for 
small  delta-T  targets.  Droop  and  undershoot  may  be  reduced  by 
greatly  increasing  the  signal  frequency  passband  relative  to  the 
low  frequency  cut  [sic],  as  in  serial  scanning,  but  this  does  not 
eliminate  the  third  defect  [that  arising  from  the  output  differences 
of  different  channels]  (p.  345). 

An  acceptable  solution  has  been  developed,  however,  through  what  is 
referred  to  as  "DC  restoration"  (Narendra,  Tack,  and  Joseph,  1978;  Lloyd, 
1975b).  It  works  as  follows:  During  the  inactive  portion  of  a  scan,  a 
detector  is  exposed  to  a  thermal  reference  source  which  allows  the  detector 
signal  coupling  capacitor  to  charge  to  a  DC  value  that  is  characteristic  of 


the  detector's  output  for  that  source.  Consequently,  when  the  detector 
starts  the  active  part  of  its  scan,  only  the  signals  varying  around  the 
reference  capacitor  voltage  are  passed  through  to  the  system  (Lloyd,  1975b). 
The  benefits  of  DC  restoration  are  apparent  in  Figure  11. 

Currently  under  development  are  a  number  of  other  image  enhancement 
techniques.  (See,  for  example,  Mengers,  1978;  Narendra,  Tack,  and 
Joseph,  1978;  and  Real  Time  FLIR  Image  Enhancement,  1977).  The 
techniques  are  intended  to  improve  various  aspects  of  the  FLIR  system, 
including  detector  responsivity  equalization,  image  contrast,  system 
sensitivity,  and  system  resolution.  Some  of  these  developments  are  intended 
for  use  in  extant  systems.  For  example,  Narendra,  Tack,  and  Joseph 
(1978)  have  developed  a  synthetic  DC  restoration  algorithm  for  systems  that 
do  not  have  a  built-in  thermal  reference.  It  uses  a  line-to-line  comparison 
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Figure  11.  Non-Restored  and  DC-Restored  Signals  (Lloyd,  1975b,  p.  346) 
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technique  to  restore  the  line-to-line  correlation  that  exists  in  most  scenes 
and  to  eliminate  the  streaking  that  occurs  in  parallel  systems  in  the  presence 
of  hot  targets. 

Other  techniques,  however,  are  being  developed  with  a  view  toward 
implementation  in  second- generation  FLIR  systems.  Narendra,  Tack,  and 
Joseph  have  evaluated  the  image  enhancement  requirements  for  the  large 
photovoltaic  array/CCD  processor  systems  that  are  currently  under 
development.  They  have  concluded  that  for  these  focal  plane  arrays,  DC 
coupling,  background  subtraction,  and  two-dimensional  contrast  enhancement 
schemes  may  prove  to  be  superior  to  traditional  AC  coupling/DC  restoration 
techniques. 

In  order  to  achieve  high  temperature  resolution  in  these  multidetector 
systems,  Narendra  and  his  colleagues  have  begun  to  address  a  number  of 
important  problems.  For  example,  they  are  exploring  new  methods  that 
would  equalize  detector  responsivity  in  these  arrays.  One  method  involves 
the  use  of  a  two- temperature  reference  near  the  focal  plane.  It  would  provide 
gain  and  offset  equalization.  A  stochastic  approach  has  also  been  developed 
which  circumvents  the  need  for  the  reference  source  to  be  uniform.  Given 
the  availability  of  these  two  methods,  Narendra  and  his  associates  conclude 
that  the  responsivity  equalization  problem  is  "tractable"  (Narendra,  Tack, 
and  Joseph.  1978). 

Narendra,  Tack,  and  Joseph  (1978)  have  also  been  working  on  a  variety  of 
other  image  enhancement  algorithms  that  would  be  implemented  in  real-time 
or  near-real-time  in  second- generation  FLIR  systems.  Particular  algorithms 
are  intended  to  enhance  contrast,  signal- to- noise  ratios  (as  measured  by  the 
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system's  minimum  resolvable  temperature),  or  resolution.  They  are 
described  in  Table  12.  While  they  can  be  implemented  individually, 
Narendra  and  his  associates  have  also  shown  that  there  is  nothing  to  prevent 
their  incorporation  into  enhancements  that  use  sophisticated  versions  of 
cascade  processing  (Narendra,  Tack,  and  Joseph,  1978). 

The  Display- -If  the  detector  signals  are  to  be  of  some  immediate  use  to  a 
FLIR  operator,  they  must  be  made  visible  once  they  have  been  processed. 
This  is  the  purpose  of  the  display;  it  makes  an  infrared  image  available  to 
the  human  operator.  Two  aspects  of  this  display  process  are  discussed 
below;  first,  the  general  nature  of  the  designs  used  to  convert  a  detector 
signal  into  a  video  signal,  and,  second,  the  parameters  that  characterize 
the  most  commonly  used  display,  the  single  element  cathode  ray  tube  (CRT). 


Detector- to- video  signal  conversion  can  be  characterized  in  terms  of  two 
FLIR  system  design  parameters;  the  scan  pattern  (parallel  or  serial)  and 
the  manner  in  which  the  preamplified  detector  signals  are  video  processed. 
Llovd  (1975b)  describes  the  three  kinds  of  video  processing  that  are  most 
commonly  used; 

Video  processing  typically  takes  one  of  three  forms;  multichannel 
serial  or  parallel  processing,  standard  television  format  processing, 
or  pseudo-TV  processing.  In  multichannel  processing  there  is  a 
one-to-one  throughput  of  detector  elements  to  display  elements.  In 
standard  video  the  final  electronic  output  of  the  system  is  a  single 
video  signal  whose  characteristics  conform  to  one  of  the  commercial 
standards  and  which  is  suitable  for  use  with  standard  composite  video 
equipment.  In  pseudo- standard  video,  a  TV-like  video  format  and 
monitor  are  used  (p.  348). 

Multichannel  systems  are  also  in  operation. 
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TABLE  12.  IMAGE  ENHANCEMENT  ALGORITHMS 


They  can  lead  to  a  "btockiness”  In  the  smoothed  images 
which  may  be  objectionable  when  the  images  have  a  Urge 
amount  of  noise  present. 


TABLE  12.  IMAGE  ENHANCEMENT  ALGORITHMS  (continued) 


Resolution  '  The  best  Implementation  may  be  in  a  CCD  analog  spatial 

filter  configuration  (similar  to  the  non-recursive  high-frequency 
emphasis  filter  mentioned  earlier  in  this  table). 


TABLE  12.  IMAGE  ENHANCEMENT  ALGORITHMS  (concluded) 


aperture  is  dictated  hv  size  constraints.  This  could  result  in  a  system  which  is  optics  limited.  In  e 
a  ayatrm.  sampling  once  per  detector  dwell  would  hopefully  be  better  than  the  Nyquist  rate  (p.  138). 
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Systems  based  on  the  TV-like  format  have  not  proven  to  be  cost  effective 
(Lloyd,  1975b).  The  most  widely  used  systems,  therefore,  tend  to  be 
classified  in  terms  of  parallel  or  serial  video  used  in  conjunction  with 
either  a  serial  or  parallel  scanner.  This  leads  to  four  common  generic 
systems:  parallel  scan /parallel  video,  parallel  scan  /serial  video,  serial 
scan/parallel  video,  and  serial  scan/serial  video.  Each  combination  has 
its  own  advantages  and  disadvantages.  For  example,  the  parallel  scan/ 
parallel  video  system  design  is  fairly  straightforward,  requires  no  scan 
synchronizer,  uses  little  power  for  its  scanner,  and  allows  for  a  cost 
effective,  compact  display.  However,  these  advantages  may  be  offset 
(depending,  of  course,  on  the  system's  intended  use)  by  a  number  of  potential 
limitations:  the  small  display  size  permits  only  one  person  to  view  it  at  a 
time;  all  channels  must  be  controlled  simultaneously  but  separately  balanced 
and  waveform- shaped;  loss  of  one  input  channel  means  the  loss  of  one  line 
of  video;  and  the  channels  may  require  DC  restoration. 


Where  scanner- to- video  format  changes  are  called  for,  video  processing 
may  become  more  complex.  In  the  case  of  parallel  scan/serial  video,  for 
example,  some  kind  of  multiplexing  is  required  (a  process  whereby  the 
system's  parallel  channels  are  reduced  to  a  single  video  channel.)^  In  light 

Lloyd  (1975b)  points  out  that  "This  system  requires  only  a  collecting 
converging  optic,  a  two-sided  scanner,  a  detector  array,  amplifying  elec¬ 
tronics,  display  drivers,  and  an  eyepiece"  (p.  349). 

*Two  approaches  to  multiplexing  are  available:  the  electronic  approach  and 
the  electro- optical  approach.  Each  approach  has  its  own  set  of  pluses  and 
minuses.  Thus,  while  the  electronic  approach  is  complex  and  may  introduce 
noise  and  transients,  jt  does  not  affect  the  bandpass  characteristics  of  the 
system.  In  contrast,  electro-optical  designs  are  relatively  easy  to  imple¬ 
ment,  noiseless  and  transient-free,  but  the  optics  that  it  introduces  into  the 
system  necessarily  affect  the  system's  bandpass  characteristics.  Both 
approaches  also  exhibit  sampling  defects  (see  Lloyd  (1975b)  for  a  more 
detailed  discussion  of  these  factors). 
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of  such  design  considerations,  the  serial  scan/serial  video  is  the  most 
direct  design  for  obtaining  a  standard  video  display  format.  It  does  not 
require  scan  conversion  or  multiplexing,  and  it  offers  (1)  the  advantages  of 
serial  scanning  that  were  described  above  and  (2)  the  availability  of  standard 
video  display  and  peripherals  (Lloyd,  1975b). 

Regardless  of  the  system  architecture  chosen,  however,  one  design 
constraint  must  be  satisifed  and  one  operational  problem  must  be  recognized. 
The  first  of  these  is  the  perfect  synchronization  between  scene  and  display 
scanning,  when  they  occur  (Llovd,  1975b).  This  condition  is  commonly  mel. 
Unfortunately,  the  complication  that  arises  from  a  FUR  system's  operation 
is  harder  to  resolve. 

The  problem  is  one  of  sampling  a  continously  varying  scene  with  a  discretely 
operating  system.  Two  kinds  of  sampling  are  possible:  window  sampling  and 
averaging  sampling  (Lloyd,  1975b).  As  described  by  Lloyd,  window  sampling 
is  the  result  of  transmission  of  an  object  distribution  through  a  periodic 
w  indow  function  (as  occurs  in  electronic  multiplexing  which  samples  each  of 
a  parallel  system's  multiple  channels  in  order  to  reduce  it  to  one  channel). 
Averaging  sampling  is  due  to  the  periodic  structure  of  an  aperture  array. 

It  results  in  the  sampling  of  the  average  value  of  the  incoming  object 
distribution  within  each  aperture  of  the  array  (and  occurs,  for  example,  in 
the  direction  that  is  perpendicular  to  the  scan  of  discrete  scene  dissection 
systems  like  televisions,  scan  converters,  etc.  ).  The  result  of  either  kind 
of  sampling  is  descriptively  the  same,  however.*  Both  lead  to  a  sampling 

This  is  not  required,  for  example,  in  a  parallel  scan /parallel  video  svstem 
(Lloyd,  1975b). 

+  See  Lloyd  (1975b)  for  their  analytic  differences. 
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of  object  distribution  and  to  the  production  of  sidebands  that  replicate  the 
object  spectrum  and  in  which  aliasing  occurs. 

Sampling  effects  directly  influence  image  quality.  The  most  notable  effects 
are  due  to  (1)  time  sampling  of  target  motion  in  the  direction  perpendicular 
to  the  direction  of  scan  and  (2)  spatial  sampling  that  occurs  as  the  result 
of  the  raster  scanning  process  (Lloyd,  1975b). 

With  these  general  issues  of  detector- to- video  signal  processing  in  mind, 
some  of  the  more  important  parameters  used  to  characterize  CRT  displays 
are  reviewed  below.  These  include  the  following:  field  of  view,  aspect 
ratio,  number  of  scan  lines  per  picture  height,  frame  rate,  interlace  ratio, 
field  rate,  modulation  transfer  function  (MTF),  bandwidth,  and  dynamic 


Aliasing  refers  to  the  fact  that  sideband  frequencies,  which  are  not  part  of 
the  original  object  spectrum,  interfere  with  object  frequencies,  even  to  the 
point  that  frequencies  along  one  dimension  (the  one  which  is  sampled)  interfere 
with  frequencies  along  the  pe:  p  ’dicular  non-sampled  dimension.  The  aliasing 
frequencies  are  hard  to  filter  c...,  Furthermore,  depending  on  the  source  of 
the  sampling  (for  example,  a  one  versus  a  two-dimensional  detector  array), 
the  aliasing  may  occur  in  one  or  two  dimensions  (Lloyd,  1975b). 

As  Sendall  and  Rosell  (1973)  point  out,  however,  in  the  case  of  multiplexing, 
aliasing  need  not  be  a  problem  if  the  bandwidth  of  each  channel  is  chosen 
appropriately,  as  follows: 

Since  the  multiplexer  is  a  time  sequential  sampling  switch 
(nonlinear)  it  is  necessary  that  the  per  channel  bandwidth  be 
limited  to  less  than  twice  the  per  channel  sampling  frequency 
(p.  110). 


range,  (Biberman,  1971;  Farrell  and  Booth,  1975;  Jones,  Freitag,  and 
Collyer,  1974;  Nash,  1978;  Sendall  and  Rosell,  1973).’ 

A  number  of  these  parameters  have  to  do  with  the  format  of  the  video 
display.  Field  of  view,  for  example,  refers  to  the  area  (in  angular  dimen¬ 
sions)  of  the  object  space  that  will  be  imaged  on  the  display.  It  need  not  be 
the  same  as  the  field  of  view  of  the  FLIR  system's  optics.  Aspect  ratio 
refers  to  the  relationship  that  exists  between  the  display's  horizontal  and 
vertical  dimensions,  independent  of  their  linear  extent,  [n  CRT  displays, 
typical  format  calls  for  a  horizontal- to- vertical  ratio  of  4:3. 


The  number  of  scan  lines  per  picture  height,  in  electro- optical  terminology, 
lias  two  possible  meanings.  It  may  refer  to  the  number  of  scan  lines  that 
make  up  the  display's  raster  or  it  may  refer  to  the  time  that  has  been 
allocated  for  scanning  each  image  frame  that  is  presented.  If  the  latter 
definition  is  the  one  being  used  (and  it  is  the  more  common  one)  then  one 
must  distinguish  between  the  number  of  lines  that  are  actually  scanned 
(active  lines)  and  the  system's  scan-line- per-picture-height  value,  which 
depends  not  only  on  the  time  it  takes  to  scan  these  lines  but  also  incorporates 
the  time  that  it  takes  to  reset  the  spot  scanner  vertically  (that  is,  the  time 


The  parameters  are  described  in  terms  of  a  line  raster  display,  one  which 
provides  a  continuous  representation  of  the  object  scene  in  one  dimension 
(typically  the  horizontal)  and  a  sampled  representation  in  the  other  (usually 
the  vertical).  Its  raster  consists  of  a  series  of  vertically  arrayed  lines, 
each  with  a  continuous  scan.  However,  the  parameters  pertain  to,  and  could 
be  described  in  terms  of,  systems  that  sample  in  both  the  horizontal  and 
vertical  dimensions.  In  such  a  case,  one  speaks  of  a  point  raster  system, 
the  raster  consisting  of  a  matrix  of  discrete  picture  elements  (pixels)  that 
are  horizontally  and  vertically  arrayed. 
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allocated  for  vertical  retrace).  For  clarification,  consider  the  following 
example  from  Farrell  and  Booth  (1975): 


By  this  last  definition,  commercial  broadcast  TV  in  the 
U.S.  is  a  525-line  system.  This  means  that  the  time  taken 
to  complete  one  scan  of  the  image  is  equal  to  52  5  individual 
line- scan  periods.  However,  fewer  than  52  5  actual  scans  are 
possible  because  approximately  3  5  of  the  periods  are  used  for 
the  vertical  retrace.  The  actual  number  used  for  vertical 
retrace  varies  from  35  to  42,  depending  upon  the  design  of  the 
transmitter.  Thus  the  number  of  actual  or- active  TV  lines,  is 
between  483  and  490,  with  490  being  the  most  common  figure 
(p.  4.1-10). 


Some  FUR  systems  use  this  kind  of  525-line  display,  but  displays  with  a 
greater  number  of  scan  lines  (for  example.  875  or  1025)  are  also  available. 
The  number  of  scan  lines  and,  more  particularly,  the  number  of  active 
scan  lines  per  picture  height,  is  an  important  display  parameter  since  it 
reflects  the  resolution  capabilities  of  the  display  (Dyall,  1978). 


Other  parameters  specify  the  rate  and  manner  of  information  transfer.  For 
example,  frame  rate  refers  to  the  number  of  times  per  second  the  object 
scene  is  completely  scanned  and  displayed.  A  typical  value  is  30  frames 
per  second.  However,  it  is  common  for  each  frame  to  be  made  up  of 
separate,  non- overlapping  fields  that  are  interlaced. 


Interlacing  refers  to  the  fact  that  each  field  is  presented  on  alternate  lines 
of  the  display's  raster.  For  example,  if  three  fields  are  used,  raster  lines 

However,  it  is  also  important  to  keep  in  mind  that  the  number  of  active 
scan  lines  does  not  correspond  to  the  number  of  cycles  of  a  periodic  target 
that  can  be  displayed.  Each  active  line  can  only  represent  a  light  or  dark 
bar,  so  that  two  scan  lines  are  required  to  represent  a  cycle  of  periodic 
spatial  information  (Farrell  and  Booth,  1975).  Also,  it  should  be  noted  that 
the  number  of  active  scan  lines  represents  the  vertical  resolution  only,  as 
modified  by  the  Kell  factor  which  is  defined  in  Table  13. 
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1,  4,  7  .  .  .  will  display  the  first  field:  lines  2,  5,  8  .  .  .  will  display 
the  second  field:  and  lines  3,  6,  9  .  .  .  will  display  the  third  field.  This 
is  an  interlacing  of  three  fields  to  one  frame,  (or  an  interlace  ratio  of 
3:1).  In  common  practice,  though,  only  two  fields  are  used  so  that  the 
interlace  ratio  is  2:1. 

Since  an  entire  frame  is  presented  at  a  rate  of  30  frames  per  second,  the 
fields  that  compose  it  must  be  presented  at  a  faster  rate  if  the  image  is  not 
to  flicker.  A  field  rate  of  60  fields  per  second  is  usually  used. 

A  last  set  of  parameters  concern  the  information  that  is  displayed  and  the 
characteristics  of  the  display.  The  display  is  intended  to  depict  the  spectral 
content  of  the  object  scene  that  has  been  transmitted  through  the  FI.IR 
system.  However,  not  ail  spatial  frequencies  are  transferred  equally  well. 
The  display's  bandpass  characteristic  is  measured  by  its  modulation 
transfer  function  (MTF).  This  is  a  plot  of  the  normalized  video  output  as 
a  function  of  sine  wave  modulated  inputs.  The  high  and  low  frequency  inputs 
that  produce  the  minimum  acceptable  outputs  determine  the  bandwidth  of  the 
display.  However,  display  bandwidth  is  influenced  by  the  interrelation  of 
interlacing  and  frame  rate,  and,  in  turn,  influences  the  resolution  of  the 
display,  as  follows: 

1)  In  terms  of  display  bandwidth  there  is  a  tradeoff  that 
exists  between  interlacing  and  frame  rate.  The  faster 

Higher-order  sequential  interlacing  (interlace  ratios  of  4;1  or  5:1,  for 
example)  introduces  artifacts  into  the  image  that  can  impair  operator 
performance.  Thus,  if  the  60-field-per  second  field  rate  (defined  in  the 
text  below)  is  used  with  these  higher-order  interlace  schemes,  line  crawl 
becomes  pronounced  (Farrell  and  Booth,  1975).  (Fine  crawl  refers  to  the 
appearance  of  brightness  differences  across  the  CRT  screen  that  appear  to 
move  in  a  direction  perpendicular  to  the  scan  lines. ) 
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the  frame  rate  the  larger  the  display's  bandwidth  must 
be.  Given  this,  interlacing  is  a  way  to  decrease  frame 
rate  (Farrell  and  Booth,  1975)  and  to  restrict  the  required 
bandwidth  (Dyall,  1978;  Farrell  and  Booth,  1975).  Never¬ 
theless,  there  are  practical  limits  to  the  usefulness  of 
interlacing.  For  example,  as  was  footnoted  above,  higher- 
order  interlacing  may  introduce  artifacts  that  can  degrade 
the  display's  overall  image  quality. 

2)  The  display's  horizontal  resolution  is  affected  by  bandwidth 
in  the  manner  described  in  Table  13. 


TABLE  13.  TELEVISION  SYSTEM  RESOLUTION  VS 
BANDWIDTH  SCAN  LINES* 


Frequency  generated  by  pickup  tube  beam  scanning  a  bar  pattern  * 

cycles  width  _  TV  lines/height  W  _ 1 _ 

active  time  height  2  H  t,.  -  t..  . 

*  line  blank 

Thus,  for  given  bandwidth  if, 

2  u 

horizontal  resolution  (TV  lines/height)  =  if  x  —  x  (t,.  -  t.  ,  .  ). 

s  W  line  blank 

vertical  resolution  =  number  of  active  scan  lines  x  Kell  factor 


=  lines  per  raster  x 


frame  time  -  blank  time 
frame  time 


x  Kell  factor 

where  the  Kell  factor  is  the  fraction  of  the  total  number  of  scan 
lines  which  actually  can  be  resolved  (about  70%,  depending  upon 
the  test  conditions). 


W  -  Picture  width 
H  -  Picture  height 
Mine  r  I.ine  time 
lblank  *  Blank  time 


Dyall,  1 978,  p.  29. 


The  remaining  parameters  relate  to  the  dynamic  range  of  the  display. 

Within  the  object  scene,  there  may  be  a  100°  temperature  difference  between 
the  cold  sky  and  a  hot  engine.  If  a  detector  can  detect  differences  of  0. 1  , 
then  1000  different  temperature  levels  are  resolvable.  This  leads  to  an 
object  scene  dynamic  range  of  1000:1.  Ideally,  this  range  will  fit  within 
the  more  limited  lun. 'nance  range  of  the  video  display.  Typically,  displays 
have  dynamic  ranges  on  the  order  of  15:1  or  30:1  (Narendra,  Tack,  and 
Joseph,  1978).  Because  of  this,  other  parameters  such  as  gamma  (Jones, 
Freitag,  and  Collyer,  1074),  display/surround  luminance  (Llovd,  1975b), 
display  square-wave  (contrast)  transfer  function  (Dvall,  1978),  and  display- 
signal- to- noise  ratio  (Farrell  and  Booth,  1975;  Jones,  Freitag,  and 
("Oliver,  1974;  Llovd,  1975b)  are  also  important.  These  will  not  be 
discussed  separately  in  this  review. 

Before  ending  this  portion  of  the  review,  however,  it  is  important  to  note 
that  human  operators  can  use  about  ten  different  levels  of  luminance  (Llovd, 
1975a;  Jones,  Freitag,  and  C’ollver,  1974),  at  best.  This  may  necessitate 
the  development  of  FLIR  systems  that  are  manually  or  automatically  adapt¬ 
able  to  different  regions  of  the  dynamic  range. 

System  f  jmitations/System  Performance--Now  that  the  components  of  the 


system  have  been  described  and  the  parameters  that  influence  their  performance 
defined  (and  where  possible  evaluated),  some  representative  parameter 
values  can  be  provided.  Many  of  these  numbers  are  classified  information 


It  is  in  order  to  maximize  the  more  limited  range  of  the  disptav  that  these 
authors  try,  in  part,  to  enhance  contrast  through  background  subtraction 
and  other  methods. 


but  those  that  are  available  for  two  FLIR  systems  are  presented  in  Table  14. 
The  F-18  FLIR  system  is  a  scanning  system;  the  other  is  a  CID  system. 
Table  15  provides  similar  and  more  complete  information  for  a  second- 
generation  CCD  FLIR  system  design. 

Ultimately,  however,  the  total  system  must  be  considered.  Two  things  are 
of  concern:  (1)  the  evaluation  of  overall  system  performance  and  (2)  the 


TABLE  14.  PARAMETER  VALUES  FOR  TWO  FLIR  SYSTEMS 


System 

PARAMETER 

CONTRACT 
SPECIFICATIONS  FOR 
F-18* 

BASELINE  CID  SYSTEM 
(used  in  a  background 
suppression  technique  evalua¬ 
tion;  detector,  optical  and  + 
system  parameters  as  noted) 

Aperture 

5.  4" x  6" 

10"  (optical  system  diameter) 

Field  of  view  (FOV) 

12°  x  12°  (wide  FOV) 

3°  x  3°  (narrow  FOV) 

5.  7°  x  5.  7°  (system  FOV) 

f  number 

f/2.41 

f/1  (optical  system  f  number) 

Resolution 

--- 

--- 

MRT  +  or  NETD* 

MRT:  --- 

NETD:  --- 

Detector  type 

--- 

InSb  (detector  material) 

Spectral  region 

1.  5  pm  -  5.  5  pm  (detector 
spectral  region) 

Nash  (1978);  Note:  these  are  not  measured  performance  values. 
^Baldwin  (1974). 

^  Defined  in  the  text  helow. 


---Classified  information. 
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TABLE  15.  SECOND-GENERATION  FLIR  SYSTEM  PARAMETERS* 


PARAMETER 

VALUE 

Aperture  (mm) 

152.4 

f /# 

3.3 

Spectral  wavelength  (pm) 

9-12 

Optical  spot  size  for  84%  encircled 
energy  (mils) 

— 

Transmission  (%) 

55 

IFOV  (prad) 

— 

Field  of  view  (deg) 

<3°  x  3° 

Frame  rate  (per  sec) 

30 

Number  of  detectors  in  parallel 

— 

Number  of  detectors  in  series 

2 

Detector  size  (mils) 

near  state  of 
the  art 

- Classified  information. 

Adapted  from  Narendra,  Tack,  and  Joseph,  1978. 


design  considerations  that  impose  performance  limitations  on  the  state-of- 
the-art  (and,  when  known,  future)  FLIR  systems. 

There  are  a  number  c.  ways  to  assess  the  overall  performance  of  a  FLIR 
system  (see,  for  example,  Lloyd,  1975b).  However,  if  one  considers  the 
purpose  of  a  FLIR  mission  and  what  distinguishes  a  FLIR  system  from 
other  electro- optical  systems,  then  there  are  two  aspects  of  a  FLIR 
system's  performance  that  one  wants  to  optimize:  its  thermal  sensitivity 
and  its  spatial  resolution. 
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Recall  that  what  distinguishes  a  FLIR  system  from  electro- optical  systems, 
in  general,  is  its  ability  to  respond  to  the  thermal  characteristics  of  the 
object  scene  it  is  scanning.  This  permits  it  to  penetrate  atmospheric 
conditions  that  leave  most  electro- optical  devices  "blind."  Remember, 
too,  that  FLIR  systems  have  to  detect  signals  that  vary  independently  of 
their  thermal  background.  Thus,  a  typical  minimum  temperature  difference 
of  interest  is  0.  5°K  or  1°K,  and  it  may  occur  within  a  scene  that  has  an 
overall  temperature  difference  of  20°K  to  100°K.  Thus,  the  thermal 
sensitivity  of  a  FLIR  system  is  of  critical  concern.  Accepted  tools  to 
evaluate  this  sensitivity  are  the  system’s  minimum  resolvable  temperature 
OVERT)  (Decker,  1976;  Lloyd,  1975b;  Sendall,  1971)  and  its  noise  equivalent 
temperature  difference  (NETD).  (See,  for  example,  Lloyd,  1975b.) 

MRT  is  operationally  defined  as  the  lowest  blackbody  temperature  difference 
that  is  required  for  an  observer  to  resolve  (with  a  probability  of  50%)  a 
four-bar,  square-wave  pattern  (with  a  bar  aspect  ratio  of  7;1  and  a  spatial 
frequency  of  ft)  when  it  is  displayed  on  a  uniform  background  by  an  infrared 
system  limited  by  white  noise.  The  MRT  of  a  proposed  Chaparrel  FLIR 
system  is  shown  in  Figure  12. 

NETD  is  usually  defined  as  the  .  .  blackbody  target- to-background 
temperature  difference  in  a  standard  test  pattern  which  produces  a  peak 
signal- to- rms- noise  [root- mean- square  noise]  ratio  (SNR)  of  one  at  the 


The  systems  MRT  and  NETD,  in  turn,  have  been  used  by  the  Army's  Night 
Vision  Laboratory  (NVL)  to  predict  operator  performance  for  various  FLIR 
systems  (Ratches,  Lawson,  Obert,  Bergemann,  Cassidy,  and  Swenson,  1975). 
Because  the  NVL  model  that  makes  these  predictions  is  evaluated  empirically 
below,  discussion  of  this  model  will  be  deferred  until  the  experiment  is 
introduced. 
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Figure  12.  Proposed  Chaparrel  MRT  (Adapted  from  Pratt,  1975) 

output  of  a  reference  electronic  filter  when  the  system  views  the  test 
pattern"  (Lloyd,  1975b).  Many  systems  in  use  today  have  an  NETD  that 
is  less  than  l^C. 

MRT  and  NETD  are  important  measures  because  they  are  related  to  the 
system's  signal-to-noise  ratio  (see,  for  example,  Lloyd,  1975a,  1975b). 
This  is  a  system  parameter,  optimized  in  a  FLIR  system,  that,  in  practice, 
cannot  always  be  optimized  in  devices  used  for  visible  spectrum  imagery. 

As  Lloyd  (1975a)  notes. 

The  theoretical  performance  limits  of  thermal  imaging  differ 
somewhat  from  those  of  visible  imaging  because  of  the  differences 
between  thermal  and  visible  scenes.  With  visible  imagery. 
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increasing  the  image  signal- to-noise  ratio  (SNR)  indefinitely 
does  not  always  produce  better  imagery  because  scene  contrasts 
can  be  so  poor  that  increasing  SNR  does  not  improve  image 
inferpretability.  With  thermal  imaging  systems  which  necessarily 
subtract  background  from  the  scene  signals,  attention  can  be 
focused  on  as  small  a  thermal  slice  as  is  desired.  Then  by 
improving  SNR  and  appropriately  adjusting  displaced  dynamic 
range,  the  information  in  the  image  can  be  increased  until  no 
more  thermal  differentials  exist  to  be  distinguished. 

Aided-vision  devices  are  designed  to  amplify  light  to  levels 
at  which  natural  scene  contrasts  are  discriminable  by  the  eye, 
bevond  which  point  improving  SNR  indefinitely  produces  diminishing 
returns.  On  the  other  hand,  thermal  imagers  are  designed  to 
produce  the  highest  practicable  image  SNRs.  Therefore,  in  FLIR 
the  fundamental  limit  of  interest  is  the  achievable  SNR,  and  we 
desire  to  know  this  limit  as  a  function  of  system  size  and 
complexity  (pp.  51-52). 


B.v  determining  the  system's  achievable  signal- to- noise  ratio,  then,  one 
can  also  determine  the  achievable  minimum  resolvable  temperature  and 
noise  equivalent  temperature  difference  (for  example,  see  Lloyd,  1975a, 
1975b), 


Turning  now  to  system  resolution,  the  reasons  for  optimizing  it  are 
apparent.  The  greater  the  amount  of  detail  that  can  be  imaged  on  the  display 
of  a  FLIR  system,  the  greater  the  chances  are  that  the  human  operator  will 
be  able  to  detect,  recognize,  and  identify  targets  of  interest. 

The  accepted  measure  of  system  resolution  is  the  system  modulation  transfer 
function.  The  transfer  function  of  the  display  was  described  above.  One 

It  should  be  noted  that  the  modulation  transfer  function  is  the  modulus  of  a 
more  complex  optical  transfer  function,  a  function  which  also  incorporates 
a  system's  phase  transfer  characteristic  (Lloyd,  1975b). 
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can  obtain  a  similar  function  independently  for  each  of  the  components  of 
the  FLIR  system.  The  system  modulation  transfer  function  is  the  multi¬ 
plicative  product  of  these  component  functions  (see,  for  example,  Mortensen, 
1978,  or  Lloyd,  1975a).  The  relationships  among  these  various  functions 
for  a  proposed  Chaparrel  FLIR  system  are  shown  in  Figure  13. 

In  order  to  see  how  the  MTF  and  MRT  functions  characterize  one  system's 
performance,  both  functions  for  the  proposed  Chaparrel  system  are  shown 
in  Figure  14. 

Given  these  basic  considerations,  there  are  a  number  of  ways  in  which  a 
FLIR  system's  performance  may  ultimately  be  limited.  Its  optics  may  be 
diffraction  limiting;  its  detectors  may  be  background  or  noise  limiting;  its 
display  may  be  resolution  or  contrast  limiting.  However,  in  current  state- 


Figure  13.  FLIR  System  and  Component  MTFs  for  a  Proposed 
Chaparrel  FLIR  System  (Pratt,  1975) 
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Figure  14.  Proposed  Chaparrel  MRT  and  MTF  (Pratt,  1975) 

of- the-  FLIR  systems,  one  speaks  more  often  in  terms  of  the  two 
performance  specifications  described  above:  the  system's  ultimate  thermal 
sensitivity  and  the  system's  spatial  resolution  capabilities. 

The  theoretical  limit  of  a  FLIR  system's  thermal  sensitivity  is  usefully 
thought  of  in  terms  of  the  signal  (a  temperature  difference  relative  to  a 
specified  background)  that  is  indistinguishable  from  the  system's  noise. 

That  is,  the  system's  thermal  sensitivity  will  be  limited  by  the  signal  that 
produces  a  signal- to- noise  ratio  of  1.  However,  the  system's  thermal 
sensitivity  typically  is  not  expressed  as  a  signal- to- noise  ratio.  Rather 
the  inverse  of  this  ratio,  the  NETD  mentioned  above,  is  used  (Lloyd,  1975a) 

See  Lloyd  (1975a)  for  a  more  analytic  treatment  of  this  topic. 


72 


To  put  this  parameter  into  some  kind  of  perspective,  Lloyd,  writing  in 
1975,  stated  that  the  best  available  FLIR  systems  could  be  expected  to  have 
a  thermal  sensitivity,  of  at  least  .21°K. 

In  projected  FLIR  systems,  large  non- scanned  photon  detector  arrays  will 
be  used  instead  of  single  scanning  detectors.  These  are  the  so  called 
"staring"  sensors  (Lloyd,  1975a).  If  the  NETD  of  these  arrays  is  calculated 
using  parameter  values  that  are  comparable  to  those  used  for  the  single 
detector  system,  one  can  expect  an  improvement  of  approximately  two  orders 
of  magnitude  on  a  per  element  basis.*  Yet,  if  these  arrays  are  not 
sensitivity-limited,  as  single  detector  systems  tend  to  he,  they  may  prove 
to  be  response-limited.  As  Lloyd  (1975a)  notes,  "Since  detection  or  energy 
conversion  in  an  incoherent  device  necessarily  occurs  before  background 
subtraction,  the  responsivities  of  the  individual  non-scanning  detecting 
elements  must  be  extremely  uniform  to  prevent  spurious  image  modulation" 


Lloyd  notes,  however,  that  NETD  is,  at  best,  a  crude  performance  measure. 

It  leaves  out  the  temporal  integration  and  spatial  filtering  effects  of  the 
human  observer's  visual  system.  These  come  into  play  when  the  viewer 
looks  at  the  FLIR  image.  If  some  of  these  effects  are  taken  into  account, 
the  typical  maximum  acceptable  NETD  for  a  single  detector  scanning  system 
is  about  .25"K  (corresponding  to  a  signal- to-noise  ratio  of  10).  Nearly 
perfect  imagery  is  produced  by  such  a  system  when  its  NETD  is  approximately 
.  12  ’K  (corresponding  to  an  effective  signal-to-noise  ratio  of  20;  Lloyd,  1975a). 

+  Lloyd  points  out  that  staring  sensors  also  operate  with  a  bandwidth  that  is 
orders  of  magnitude  narrower  than  the  bandwidth  of  a  system  that  has  only 
a  single  scanning  detector  (maybe  30  Hz).  This  is  achieved  (1)  at  the  price 
of  needing  orders  of  magnitude  more  detectors  but  (2)  despite  the  fact  that 
these  detectors  may  not  be  operating  very  efficiently  (Lloyd,  1975a).  That 
is,  because  these  large  detector  arrays  are  difficult  to  cold-shield,  the  detectors 
are  not  likely  to  be  background-limited. 


73 


(p.  54).  \nv  nonuniformities  that  do  exist  constitute  a  source  of  relatively 
fixed-pattern  noise  that  can  interfere  with  performance. 


As  thermal  sensitivity  is  theoretically  and  practically  limited  in  FLIR 
systems,  so  is  spatial  resolution.  In  present  state-of-the-art  systems 
there  are  a  number  of  limiting  sources.  The  primary  limit  to  angular 
spatial  resolution  is  the  diffraction  limit  of  the  optical  system.  But  it  is 
not  the  limiting  factor  of  the  overall  FLIR  system.  Lloyd  (1975a)  states  that, 

.  .  .  the  detector  angular  subtense,  the  detector  temporal 
frequency  response,  the  signal  processing  response,  the  video 
monitor  spot  size,  and  manufacturing  tolerances  all  contribute 
to  reducing  resolving  power.  In  current  FLIR  designs  the 
detector  angular  subtense  a  is  the  limiting  factor,  and 
determines  the  system  cut-off  at  a  frequency  of  1/or.  Once 
I  he  svstem  field  of  view  and  the  detector  angular  subtense  are 
determined,  the  diameter  of  the  optic  is  usually  set  by  the 
thermal  sensitivity  requirements  and  not  by  the  desired 
resolution. 

The  result  is  that  the  spatial  frequency  limit  set  by  the  optic 
is  typically  at  best  double  the  limit  set  by  the  detector  subtense. 
Consequently,  the  diffraction  limit  on  resolution  does  not  deter¬ 
mine  current  FLIR  performance  (p.  55). 

Nevertheless,  Lloyd  adds  that  the  practical  limit  to  FLIR  resolution  may, 
in  fact,  have  nothing  to  do  with  the  system  itself.  Rather,  in  his  words. 

The  practical  limit  to  FLIR  resolution  is  likely  to  be  the  MTF  of 
the  atmosphere  due  to  turbulence.  At  present,  this  limit  as  a  function 
of  atmospheric  conditions  is  not  well  understood  (Lloyd,  1975a,  p.  55). 


The  cooling  requirements  of  these  large  sensor  arrays  also  present  a 
potential  limitation.  Recent  advances  have  decreased  the  total  power 
consumption  of  a  high  performance  FLIR  system  to  below  a  kilowatt.  But 
because  staring  arrays  require  that  a  lot  of  circuitry  be  put  on  the  cold 
head  of  the  detector  dewar,  in  their  case  some  of  these  gains  are  likely  to 
be  negated  (Lloyd,  1975a). 
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One  can  express  the  resolution  capabilities  of  a  FLIFt  system  in  terms  of 
a  system  MTF.  This  will  tend  to  have  a  gaussian  shape  described  by 

MTF(f)  =  exp  <-2"2  a2  f2) 

where  a  is  the  standard  deviation  of  the  system  line  spread  function  (in 
mrad)  and  f  is  a  spatial  frequency  (in  cycles/ mrad).  For  a  good  system 
ct  will  be  in  the  region  of  0,  5#  s  ff  s  0.  6a  (Lloyd,  1975a)  and  represents 
the  detector's  angular  subtence  (in  mrad). 


In  light  of  the  described  limits  to  thermal  sensitivity  and  spatial  resolution. 
Lloyd  (1975a)  summarizes  the  existing  state-of-the-art  of  FI.IR  systems 
and  the  prospects  for  the  future  in  this  way: 

The  state-of-the-art  in  thermal  imaging  systems  is  that  in  the 
best  instruments,  thermal  sensitivity  is  a  factor  of  two  worse  than 
the  theoretical  limit.  This  is  due  to  the  achievable  efficiency 
factors  of  the  optics,  the  scanner,  the  cold  shield,  and  the 
detector.  Theoretical  limits  of  resolution  are  not  approached 
because  apertures  are  determined  by  the  required  thermal 
sensitivity,  so  that  the  diffraction  limit  exceeds  the  resolution 
set  by  the  detector  size. 

Development  efforts  over  the  past  decade  have  been  directed 
toward  achieving  the  theoretical  limit  using  scanning  systems 
with  the  fewest  possible  detectors.  Since  the  prospects  for 
significantly  improving  efficiency  are  not  good,  future  efforts 
will  be  directed  toward  improving  thermal  sensitivity  by  greatly 
increasing  the  number  of  detectors.  During  the  next  decade, 
it  is  likely  that  mechanical  scanning  will  continue  to  be  the 
preferred  method  for  thermal  imaging,  with  self- scanned  arrays 
being  far  in  the  future. 

FUR  systems  are  evolving  sufficiently  so  that  their  weight, 
power  consumption,  performance,  and  most  importantly  their 
cost,  will  permit  widespread  civilian  and  military  use.  In 
terms  of  overall  image  quality,  FLIR  has  attained  the  reproduction 
standards  of  broadcast  television  (p.  56). 
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Human  Operator  Performance  Factors 


In  his  1975  book  on  thermal  imaging  systems,  Lloyd  lists  no  less  than  44 
variables  that  can  influence  human  operator  performance,  noting  that,  even 
at  that,  the  list  is  not  exhaustive.  Some  of  these  variables  are  specific  to 
the  FLIR  system;  among  them  are  frame  rate,  dynamic  range,  and  measures 
of  resolution.  Other  variables  have  to  do  with  states  of  the  observer 
(including  training,  prebriefing,  workload,  and  peripheral  visual  acuity), 
characteristics  of  the  scene  (such  as  background  luminance  or  amount  of 
clutter),  or  the  operator's  own  situation  (for  example,  required  search  area, 
ambient  illumination,  permitted  search  time,  and  vehicle  vibration).  A 
final  set  of  variables  has  to  do  with  the  properties  of  the  displayed  targets. 
These  include  critical  angular  subtense,  contrast  ratio,  contour  complexity, 
and  location  on  the  display;  however,  these  sets  of  variables  will  not  be 
surveyed  here.  Similarly,  models  of  the  human  operator  (for  example, 
Schnitzler,  1973)  and  aspects  of  the  FLIR  system  design*  that  rest  upon 
human  physiological  and  perceptual  processes  will  not  be  emphasized. 

Instead,  the  present  review  focuses  upon  two  parameters:  system  resolution 


Many  of  these  variables  (or  variables  like  them)  have  been  comprehensively 
reviewed  elsewhere.  (The  reader  is  encouraged  to  see,  for  example,  Farrell 
and  Booth,  1975;  Jones,  Freitag,  and  Collyer,  1974;  and  Lloyd,  1975b.) 

Consider  as  examples  three  aspects  of  design  that  are  now  taken  for  granted: 
First,  that  the  FLIR  system  converts  thermal  radiation  into  visible  light, 
and  not  some  other  form  of  energy;  second,  that  the  standard  4:3  aspect 
ratio  of  the  display  corresponds  to  the  proportions  of  the  eye's  "moderate 
quality  field  of  view"  (Lloyd,  1975b,  p.  117)--the  field  of  view  that  is  used 
for  most  visual  tasks;  and  third,  that  the  field  and  effective  frame  rate  of 
the  FLIR  system  are  selected,  in  part,  to  be  above  the  eye's  critical  flicker- 
fusion  frequency  (Lloyd,  1975b),  The  critical  flicker-fusion  frequency  is  the 
frequency  at  which  the  perception  of  image  frame  fluctuations  gives  way  to 
the  appearance  of  a  uniform  and  persistent  image,  when  the  observer  is 
standing  far  enough  away  from  the  display  so  that  the  raster  lines  are  not 
resolvable. 
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and  system  sensitivity.  Because  these  parameters  are  of  central  concern 
to  the  optimization  of  FLIR  systems,  particular  attention  will  be  paid  to  the 
tradeoff  and  asymptotic  relationships  that  exist  between  system  resolution 
and  system  sensitivity  and  their  effects  upon  operator  performance,  as  well 
as  to  the  dependence  of  these  effects  on  the  limiting  factors  of  the  system 
being  used.  In  the  research  reported  below  the  influence  of  these  parameters 
on  operator  performance  will  be  assessed  empirically  for  first-  and  second- 
generation  FLIR  systems. 

Resolution- -There  are  two  aspects  to  system  resolution  and  its  effects  upon 
operator  performance.  The  first  concerns  the  effects  of  a  display's  raster 
structure  upon  an  operator's  ability  to  accomplish  different  tasks;  the 
second  pertains  to  the  spatial  resolution  of  the  system  in  the  direction  of  the 
raster's  scan.  Each  aspect  will  be  discussed  in  turn. 

The  effects  of  raster  structure  have  commonly  been  studied  in  terms  of  the 
resolution  required  for  particular  operator  tasks.  J.  Johnson  (Johnson, 

1958)  showed  that  the  resolution  needed  to  satisfy  different  target  acquisition 
criteria- -detection,  orientation;  recognition,  and  identification- -could  be 
specified  independently  of  particular  targets  or  the  camera- to- target 
distance.  He  did  this  by  developing  the  concept  of  the  equivalent  bar  pattern. 

Equivalent  bar  patterns  are  square  wave  patterns  that  completely  fill  the 
projected  minimum  dimension  of  a  target  and  are  as  long,  projectively,  as 
the  target  in  the  direction  perpendicular  to  that  minimum  dimension.  Table 
16  shows  that  the  resolution  requirements  for  a  particular  target  acquisition 
task  can  be  specified  fairly  precisely  and  that  more  exacting  decisions 
require  better  resolution. 


TABLE  16.  JOHNSON’S  TARGET  ACQUISITION  CRITERIA  AND  DATA 


A.  LEVELS  OF  DISCRIMINATION  DEFINED 


Classification  of 
Discrimination  Level 

Detection 

Orientation 


Recognition 


Identification 


Definition 

An  object  is  present. 

The  object  is  approximately  symmetric  or 
asymmetric  and  its  orientation  may  be 
discerned. 

The  class  to  which  the  object  belongs  may 
be  discerned  (for  example,  gun,  truck,  man,  etc. ) 

The  target  can  be  described  to  the  limit  of  the 
observer's  knowledge  (for  example,  105  mm 
howitzer,  jeep,  soldier,  etc. ) 


B.  JOHNSON'S  CRITERIA  FOR  REQUIRED  RESOLUTION 


Target 


Resolution  (in  TV  lines)  per  Minimum  Dimension 


Broadside  View 

Detection 

Orientation 

Recognition 

Identification 

Truck 

1.8 

2.  5 

9.  0 

16.  0 

M- 48  Tank 

1.5 

2.4 

7.0 

14.0 

Stalin  Tank 

1.  5 

2.4 

6.  6 

12.0 

Centurion  Tank 

1.5 

2.  4 

7.0 

12.0 

Half-Track 

2.0 

3.0 

8.0 

10.0 

J  eep 

2.4 

3.0 

9.0 

11.0 

Command  Car 

2.4 

3.  0 

8.  6 

11.0 

Solder  (Standing) 

3.0 

3.  6 

7.  6 

16.0 

105  Howitzer 

2.0 

3.  0 

9.  6 

12.0 

Average 

2. 0  ±  .  5 

2.8  ±  .7 

8.  0  ±  1. 6 

12.8  ±3.0 

Jones,  Freitag,  and  Collyer,  1974,  p.  4-8. 


The  resolution  requirements  for  Johnson's  decision  criteria  have  been 
corroborated  in  a  number  of  experimental  situations.  For  example,  several 
studies  have  examined  how  resolution  (measured  in  scan  lines)  influences 
operator  performance  at  a  given  level  of  decision).  In  many  of  these  studies 
raster  size  is  held  constant  while  target  image  size  is  varied  in  order  to 
change  the  number  of  scan  lines  lying  across  a  target.  These  studies,  by 
and  large,  validate  Johnson's  findings.  Thus,  Scott,  Hollands,  and 
Harabedian  (1970),  using  high  contrast,  noiseless  photographic  imagery, 
found  that  any  more  than  13.5  scan  lines  per  target  produced  little  change 
in  identification  performance  for  most  of  the  targets  used.  Similarly, 
Erickson  (1978)  has  reviewed  a  number  of  target  acquisition  experiments 
that  use  electro-optical  raster  scan  systems.  Although  they  differ  in  their 
particulars,  several  are  formally  comparable  to  Scott's  experiment.  The 
data  from  these  experiments  were  fairly  consistent  for  recognition 
performance.  Most  targets  required  10  to  12  scan  lines  for  recognition.  The 
detection  data  were  less  consistent;  three  to  nine  scan  lines  were  required, 
depending  on  the  target.  Still,  these  figures  are  in  fairly  close  accord  with 
J ohnson's  data. 

Other  studies  (such  as  Baker  and  Nicholson,  1967;  Erickson  and  Hemingway, 
1970,  cited  in  Erickson,  1978;  and  Humes  and  Bauerschmidt,  1968)  have 
varied  target  size  and  raster  structure  independently.^  It  is  found  again 


In  these  studies,  then,  it  is  important  to  note  that  the  effects  of  target  size 
and  number  of  scan  lines  per  target  height  are  inextricably  related. 

f  Note,  however,  that  when  these  experiments  took  into  account  Die  variability 
among  the  subjects,  they  concluded  that  20  scan  lines  per  vehicle  would 
result  in  a  more  homogeneous  level  of  performance  across  observers, 
t 

Also  see  Scanlan,  1976. 


79 


that  operator  performance  varies  as  a  function  of  raster  structure 
(measured  either  in  terms  of  the  lines  per  image--Baker  and  Nicholson, 

1967;  Erickson  and  Hemingway,  1970- -or  lines  per  picture  height- -Humes 
and  Bauerschmidt,  1968)  and  is  optimized  by  having  a  certain  number  - r 
lines  per  image  height  (see  Baker  and  Nicholson,  1967,  and  Erickson,  1978). 
What  is  also  of  note  in  these  studies  is  that  asymptotic  levels  of  performance 
that  are  less  than  100%  are  attained.  As  an  example,  consider  one  of  the 
studies  that  Erickson  (1978)  reviews.  In  this  study  target  size,  target 
background,  and  the  number  of  scan  lines  across  the  target  are  independently 
varied.  The  results  of  this  study  are  shown  in  Figure  15.  Note  that  although 
background  and  target  size  each  influence  identification  performance,  they 
do  not  alter  the  scan  line  requirement.  Regardless  of  the  level  of  perform¬ 
ance  that  is  attained,  it  does  not  improve  substantially  after  there  are  10 
scan  lines  across  the  target.  This  suggests  that  raster  composition  can 
limit  target  acquisition  performance,  but  also  that  a  point  is  reached  after 
which  other  variables  dominate  as  limiting  factors.* 

Humes  and  Bauerschmidt  (1968)  did  not  perform  a  comparable  analysis. 

What  they  find,  however,  is  that  the  optimal  number  of  scan  lines  depends 
on  viewing  angle  and  target  size. 

^There  are  other  reasons  not  to  overinterpret  the  results  that  have  been 
presented  thus  far:  The  line  criteria  that  are  summarized  in  Table  15  may 
be  limited  to  the  particular  angle  from  which  the  targets  were  viewed 
(Johnson  and  Lawson,  1974;  Jones,  Freitag,  and  Collyer,  1974);  they  assume 
the  targets  are  of  uniform  luminance  (Jones,  Freitag,  and  Collver,  1974), 
and  they  assume  that  the  bar  equivalents  are  always  of  the  same  contrast 
as  the  targets  themselves.  Lloyd  (  1975b)  points  out  that,  for  infrared  imagerv, 
this  means  that  the  equivalent  bar  patterns  have  to  have  the  same  apparent 
delta-T  as  the  target  and  be  viewed  under  the  same  conditions.  )  However, 
while  Johnson  and  the  other  experimenters  mentioned  above  always  u  -ed 
levels  of  contrast  that  were  sufficient  to  accomplish  their  required  tasks, 

FLIR  imagery  is  often  low-contrast.  Thus,  the  line  criteria  that  have  been 
summarized  may  not  be  applicable  to  FLIR  systems  without  taking  into 
account  the  functional  interrelations  that  exist  among  sensor /observer 
resolution,  image  contrast,  and  image  signal- to-noise  ratio  (Jones,  Freitag, 
and  Collyer,  1974;  Rosell  and  Willson,  1973). 
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SCAN  UNES  MAKING  UP  IMAGE 
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SANDY  BACKGROUND.  OBLIQUE 


Figure  15.  Vehicle  Identification  on  Television  (Target  size, 

in  Minutes  of  Arc,  is  Given  for  Each  Set  of  Curves) 
(Erickson,  1978,  p.  578) 


Several  variables  are  suggested  by  the  literature;  among  these  are  spatial 
resolution  in  the  direction  of  the  raster  scan  and  signal- to- noise  ratio. 

Spatial  resolution  in  the  direction  of  the  scan  is  the  next  topic  discussed; 
signal- to-noise  ratio  is  dealt  with  in  the  following  section  of  the  reporl. 

Resolution  in  the  direction  of  the  raster  scan  is  typically  measured  by  the 
system's  modulation  transfer  function.  A  look  at  Figure  14  shows  that  the 
modulation  transfer  function  representing  a  system's  spatial  resolution 
capabilities  can  be  characterized  by  its  bandwidth  of  spatial  frequency 
transmission,  its  shape,  and  the  area  that  lies  below  the  envelope  of  the 
curve.  Kach  of  these  parameters  of  the  curve  has  been  evaluated  in  terms 
of  its  effect  on  an  operator's  target  acquisition  performance. 

There  are  some  indications  that  wider  bandwidths  lead  to  relatively  better 
target  identification  performance  (Shanahan,  1964;  Task.  1979)  and  that 
the  effects  of  bandwidth  interact  with  target  contrast  (Shanahan,  1964). 
However,  the  results  from  another  study  (Humes  and  Bauerschmidt,  1966) 
are  less  conclusive.  There  is  also  accumulating  evidence  that  operator 
performance  is  relatable  to  other  bandpass  characteristics  of  an  imagery 
system.  Schade  (1964;  also  see  Lloyd,  1975b)  has  written  that  the  overall 
shape  of  the  modulation  transfer  function  can  influence  how  an  image  is 
perceived.  He  has  stated  that  systems  that  have  a  Gaussian  sine-wave 
response  curve  are  judged  to  have  good  image  quality  insofar  as  it  approaches 
the  form  of  the  visual  system’s  own  response  curve.  Significant  departures 
from  this  general  form  are  judged  to  be  inferior  (or,  in  Schade's  words, 
"unnatural  or  defective,  "  p.  20). 

Other  variables  include  target  contrasts  and  target  size;  they  are  not 
discussed,  per  se,  in  this  paper. 
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Regardless  of  the  shape  of  an  imagery  system's  modulation  transfer 
function,  the  area  underneath  it  (the  MFTA)  also  appears  to  be  an  important 
system  parameter.  .  Conceptually,  this  area  function  indexes  the  "amount" 
of  spatial  information  that  is  transmitted  by  the  system.  Several  measures 
based  upon  this  area  have  been  proposed  (see  Sendall,  1971).  Several  of 
these  measures,  in  turn,  take  into  account  the  operator's  threshold  require¬ 
ments  for  performance  tasks  (see,  for  example,  Charman  and  Olin,  1965; 
Snyder,  1973,  1974,  1976;  Snyder,  Keesee,  Beamon,  and  Aschensach,  1974; 
Task,  1979;  Task,  Pinkus,  and  Hornseth,  1978;  Task  and  Verona,  1976). 
The  latter  measurement  approach,  which  can  be  thought  of  as  indexing  the 
spatial  information  that  is  usable  by  an  operator,  is  demonstrated  in 
Figure  16. 

By  and  large,  the  area  measures  of  spatial  information  transmission  are 
related  to  subjective  impressions  of  image  quality  (Schade,  1964),  to  the 
resolving  power  of  the  imaging  system  (Charman  and  Olin,  1965),  and  to 
overall  target  recognition  performance  (Snyder,  1973;  Snyder,  Keesee, 
Beamon  and  Aschenbach,  1974).  It  should  be  noted  that  those  measures 
which  adjust  for  operator  requirements  are  more  highly  related  to  overall 
performance  than  those  that  do  not  (Task,  1979;  also  see  Snyder,  Keesee, 
Beamon  and  Aschenbach,  1974).  Also,  the  relationship  between  the  area 
measure  of  spatial  resolution  and  performance  appears  to  be  fairly  robust; 


These  measures  have  been  less  successful  in  relating  operator  performance 
to  the  recognition  of  particular  individual  targets  (see,  for  example,  Snvder, 
1973;  but  also  see  Snyder,  Keesee,  Beamon,  and  Aschenbach,  1974,  for 
more  promising  results ). 
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Figure  16.  Modulation  Transfer  Function  Area  (MTFA) 
(Snyder,  1976,  p.  8) 


that  is,  experiments  that  manipulate  the  area  function  in  different  ways 
arrive  at  similar  findings.  This  suggests  that  it  is  not  spatial  resolution 
(as  represented  by  the  system's  modulation  transfer  function)  per  se  that 
influences  operator  performance.  Rather,  it  is  spatial  information  that  is 
usable  by  the  operator  that  is  of  principal  importance  and  may  ultimately 
determine  a  system's  usefulness/ 


Sensitivity:  Signal- to-Noise  Ratio- -The  performance  limitations  that  are 
attributable  to  a  display's  raster  structure  or  to  its  spatial  resolution  in  the 
direction  of  the  raster  scan  are  important,  but  they  certainly  are  not  the 
only  system  parameters  that  affect  operator  performance.  In  fact,  the 
actual  importance  of  the  observed  resolution  effects  may  be  related  to  the 
extent  to  which  the  imaging  system  is  aperture-,  as  opposed  to  noise-, 
limited  (Rosell,  1975)  or  the  extent  to  which  the  effects  themselves  are 
not  a  function  of  other  sampling  or  signal- to- noise  ratio  considerations 


For  example,  Snyder  (1973,  1974)  and  Snyder,  Keesee,  Beamon,  and 
Aschenbach  (1974)  vary  signal -to- noise  level--and  thereby  the  observer's 
threshold  requirements --with  respect  to  a  fixed  modulation  transfer  function, 
while  Task  (1979)  and  Task,  Pinkus,  and  Hornseth  (1978)  vary  bandwidth 
and  contrast  ratio  of  the  display. 

*The  limiting  resolution  of  the  system  also  depends  upon  the  operator's 
threshold  demand  characteristics  as  shown  in  Figure  16.  However,  it  is 
not  as  highly  correlated  with  operator  performance  as  are  other  system 
parameters  (Task  1979;  Task,  Pinkus,  and  Hornseth,  1978;  also  see 
Coluccio,  Macleod.  and  Maier,  1969).  This  suggests  that  effective  system 
bandwidth  may  not  have  as  important  an  influence  on  the  performance  on 
target  acquisition  tasks  as  the  effective  information  that  is  passed  through 
the  system. 
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(Biberman,  1974).  Nevertheless,  even  though  signal- lo-noise  and  resolution 
are  integrally  related  to  one  another  (Biberman,  1974;  Rosell,  1975;  Snyder, 
Keesee,  Beamon,  and  Aschenbach,  1974)  the  effects  of  the  former  have  most 
often  been  studied  independently  of  the  latter. 

In  general,  one  finds  that  increases  in  a  system's  signal- to- noise  ratio 
enable  an  operator  to  improve  his  performance.  For  example,  I.evine, 

Jauer,  and  Kozlowski  (cited  in  Erickson,  1978)  had  subjects  look  at  a  TV 
monitor  that  was  viewing  photographs.  The  subjects  had  to  make  detection, 
recognition,  and  identification  responses  as  the  signal- to- noise  ratio 
(measured  as  the  square  root  of  the  video- root- mean- square  voltage  to 
the  noise -root -mean -square  voltage)  was  incremented  in  steps  from  4  to 
100.  The  number  of  scan  lines  per  target  was  also  manipulated;  6  TV  lines, 
8.  67  TV  lines,  and  11.16  TV  lines  per  target  were  used.  In  keeping  with 
the  results  described  in  the  last  section,  the  number  of  correct  responses 
decreased  as  the  decision  level  became  harder  and  there  was  a  large 
improvement  in  performance  going  from  6  lines  per  target  to  8.  67  lines 
per  target,  but  little  after  that.  Considering  signal- to- noise  ratio  alone, 
as  the  signal- to- noise  ratio  was  increased,  performance  improved  without 
asvmptot  ing. 

Other  studies,  however,  have  not  shown  this  continued  improvement  with 
increasing  signal- to- noise  ratio.  Rather,  they  have  shown  that  larger 


For  example,  as  was  noted  above,  Snyder  manipulated  the  signal- to-noise 
ratio  of  the  system  he  was  using  in  order  to  alter  the  operator's  demand 
requirements  for  the  tasks  that  he  was  studying.  The  usable  spatial  infor¬ 
mation  represented  by  the  area  below  his  system's  modulation  transfer 
function  was  thereby  altered  and  operator  performance  was  affected  accord¬ 
ingly  (Snyder,  1973,  1974;  Snyder,  Keesee,  Beamon,  and  Aschenbach,  1974). 


signal- to-noise  ratios  do  improve  operator  performance,  but  only  up  to 
some  limit.  Thus,  in  the  data  from  the  Humes  and  Bauerschmidt  experiment 
(Humes  and  Bauerschmidt,  1968),  one  observes  an  improvement  in  both 
target  recognition  accuracy  and  latency  as  one  goes  from  signal- to- noise 
ratios  of  1  dB  to  16  dB.  The  still  higher  signal- to-noise  ratio  of  37.6  dB 
did  not  markedly  better  performance  on  either  of  these  response  measures, 
although  some  further  improvement  did  occur. 

Hollands,  Scott,  and  Harabedian  (1970)  obtained  data  comparable  to  this 
using  photographs  as  their  imagery  base.  Stimuli  varied  both  in  terms  of 
the  number  of  scan  lines  across  the  vehicle  and  in  terms  of  the  signal- to- 
noise  ratio  (computed  as  square  root  of  the  ratio  of  signal  variance  to  noise 
variance)/  They  found  that  target  identification  varied  as  a  function  of 
both  the  number  of  scan  lines  per  vehicle  and  the  signal- to- noise  ratio  used. 

Of  particular  note  are  the  following  results  from  Hollands's  experiment; 

In  the  presence  of  noise,  30  or  40  lines  per  vehicle  (compared  with  20  lines 
per  object  reported  by  Scott,  Hollands,  and  Harabedian,  1970,  for  noiseless, 
high  contrast  imagery)  were  required  to  produce  an  identification  accuracy 
of  80%-90%,  depending  on  the  vehicle  and  the  level  of  noise  present  in  the 


The  same  general  effects  were  observed  for  10  small  and  10  large  targets 
and  12  high  and  12  low-contrast  targets.  However,  size  and  contrast  did 
influence  the  level  of  performance  attained.  When  compared  with  the  large 
targets,  the  small  targets  appeared  to  be  responded  to  more  slowly 
(especially  at  the  lower  signal- to- noise  ratios)  and  less  accurately  (by  about 
10%  at  the  highest  signal-to-noise  ratios).  The  same  effects  are  observed 
when  performance  on  the  low- contrast  targets  is  compared  with  performance 
on  the  high- contrast  targets. 

Target  size  and  number  of  scan  lines  per  target  are  again  experimentally 
confounded  in  this  study. 
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image.  In  fact,  resolution  proved  to  be  the  limiting  factor  in  the  experiment, 
since  even  with  an  infinite  signal- to- noise  ratio,  not  every  target  was 
identified  every  time.  Given  the  signal- to- noise  ratios  that  were  used  (3, 

5,  10,  20,  30,  infinity),  performance  improved  only  slightly  (about  5%) 
beyond  the  ratio  of  20  and  only  20%  beyond  the  ratio  of  10.  What  is  significant 
about  their  data  is  that  they  reflect  a  tradeoff  between  resolution  and  signal- 
to-noise.  Within  limits  a  reduction  in  one  could  be  compensated  for  by  an 
increase  in  the  other /  This  is  shown  in  the  equal- identification  accuracy 
curves  shown  in  Figures  17a  and  17b. 


This  finding  seems  to  support  the  view  of  some  systems  analysts  that  one 
does  not  need  the  40  dB  signal- to- noise  ratios  that  have  been  sought  for 
military  applications,  at  least  for  target  acquisition  applications.  For 
example,  one  analyst  suggests  that  to  detect  the  2%  thermal  contrasts  that 
are  of  interest,  a  9  dB  signal- to- noise  ratio  may  be  adequate.  He  adds 
that,  at  this  level  of  noise,  the  FLIR  system  will  be  noise-limited  so  that 
MTF  measurements  will  not  be  very  useful,  (Miller,  1979).  Other  data 
also  may  be  of  limited  applicability.  There  are  two  reasons  for  this: 

First,  for  the  most  part,  the  data  involve  the  use  of  high-contrast  imagery. 
Second,  they  depend  upon  the  perception  of  static  scenes.  Temporal  factors, 
such  as  frame  rate  (£")  and  temporal  integration  period  of  the  eye  (Te>  also 
influence  operator  performance.  They  enable  one  to  establish  a  perceptual 
signal- to- noise  ratio  that  depends  upon,  but  is  effectively  better  than,  the 
measured  ratio  of  any  given  frame  by  a  factor  of  ^Te  F  (Lloyd,  1975b).  Its 
effect  is  apparent  in  the  Williams  and  Erickson  study  that  is  discussed  below 
(Williams  and  Erickson,  1976). 

Related  effects  have  been  observed  by  Snyder,  Keesee,  Beamon,  and 
Aschenbach  (1974).  Other  tradeoffs  have  been  reported  between  target/ 
background  contrast  and  display  resolution  measured  in  TV  lines  (Scanlan, 
1976);  and  between  image  contrast  and  limiting  resolution  (Coluccio, 
MacLeod,  and  Maier,  1969). 
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a.  Equal-Identification  Accuracy  b.  Equal- Identification  Accuracy 
Curves  for  Tanks  Curves  for  Miscellaneous 

Vehicles 

Figure  17.  Equal- Identification  Accuracy  Curves  for  Two  Classes  of 

Vehicles  (Hollanda,  Scott,  and  Harabedian,  1970,  pp.  411,  412) 

This  demonstrated  tradeoff  between  resolution  and  signal- to- noise  is  impor¬ 
tant.  One  of  the  implications  of  this  relationship  is  brought  out  by  two 
studies  reviewed  by  Rosell  (1975).  Each  study  found  that  when  a  sensor  is 
noise-limited  the  resolution  required  to  perform  a  critical  task  is  higher 
than  when  the  sensor  is  aperture-limited.  This  finding  forces  one  to 
re-evaluate  the  Johnson  criteria  presented  in  the  preceding  section  of  this 
review.  In  light  of  the  data  that  Rosell  presents,  the  line  criteria  given  in 
Table  15  for  Johnson's  decision  levels  should  not  be  considered  invariant. 

As  Rosell  concludes,  ".  .  .  it  was  found  that  a  single  resolution  requirement 
is  not  sufficient;  more  resolution  will  be  needed  when  the  sensor's  resolu¬ 
tion  is  noise-limited  as  opposed  to  aperture-limited"  (Rosell,  1975,  p.  334). 


89 


This  statement  suggests  the  general  conclusion  that  could  be  drawn  from 
the  data  presented  in  this  and  the  preceding  section  of  this  review,  namely, 
that  operator  performance  may  be  limited,  ultimately,  by  the  limiting 
factors  of  the  system  itself. 

Resolution  and  Signal- to-Noise  as  They  Pertain  to  FLIR  System  Design- - 
From  the  previous  two  sections  it  is  clear  that  resolution  (both  across  and 
along  the  raster)  and  sensitivity  (as  reflected  in  a  system's  signal- to- noise 
ratio)  are  important  determinants  of  operator  performance.  However,  most 
of  the  data  presented  came  from  research  that  used  photographic  and/or 
television  imagery.  Only  recently  has  FLIP  imagery  been  used  in  this  kind 
of  study.  Consider  as  an  example  the  experiments  of  Williams  and 
Erickson  (1976). 

Williams  and  Erickson  carried  out  three  experiments  that  used  relatively 
high- contrast,  simulated,  FLIR  imagery.  The  first  examined  the  effects  of 
number  of  scan  lines,  horizontal  modulation  transfer  function,  noise,  and 
magnification  on  FLIR  target  recognition. 

Recognition  time  and  accuracy  performance  were  most  influenced  by  the 
number  of  scan  lines  (and  therefore  average  lines  per  target,  since  target 
areas  remained  constant  under  this  manipulation)  and  noise.’  System 
resolution  (as  measured  by  three-bar  test  patterns)  was  the  best  predictor 
of  this  performance.  This,  in  turn,  was  most  influenced  by  the  number  of 
scan  lines  and  the  level  of  magnification. 

Root  mean  square  noise  was  a  better  predictor  of  performance  than  other 
signal- to- noise  measures  that  took  target  intensity  into  account. 


In  their  second  experiment,  Williams  and  Erickson  studied  the  effects 
of  number  of  scan  lines,  scan  aperture  size,  noise,  and  magnification  on 
FLIP  target  recognition  performance.  A  number  of  interesting  results 
were  obtained.  First,  recognition  accuracy  varied  directly  as  a  function 
of  the  signal-to-noise  ratio.  Second,  the  optimum  scan  aperture  varied 
directly  with  the  level  of  noise.  When  more  noise  was  present,  a  larger 
aperture  acted  as  a  smoothing  filter.  Third,  for  an  aperture  of  a  given 
size,  performance  was  improved  as  a  function  of  the  number  of  scan  lines 
present  (that  is,  overscanning).  Fourth,  the  effect  of  magnification 
interacted  with  the  other  variables.  With  a  typical  low-resolution,  noisy 
image  a  point  was  reached  where  magnification  no  longer  bettered  recogni¬ 
tion  performance.  In  fact,  in  images  where  resolution  was  very  coarse, 
magnification  was  detrimental  to  performance.  Only  the  performance  on 
noiseless,  high-resolution  pictures  was  aided  by  magnification.  Finally, 
the  best  predictor  of  performance  was  the  displayed  maximum  dimension 
of  a  target  divided  by  system  resolution  (as  measured  by  resolvable  cycles 
on  a  checkerboard  pattern). 


Three  points  must  be  made  here.  First,  the  fact  that  the  target's  maximum 
dimension  correlated  more  highly  with  performance  than  did  the  minimum 
dimension  argues  against  the  use  of  the  Johnson  criteria  in  this  instance. 

So  do  other  aspects  of  Williams  and  Erickson's  data.  Second,  the  use  of  r 
checkerboard  pattern  to  measure  resolution  is  a  unique  aspect  of  this 
experiment;  compared  with  resolution  measured  by  standard  three-bar 
patterns,  resolution  measured  by  the  checkerboard  patterns  was  more 
closely  related  to  the  obtained  recognition  performance.  Third,  when 
resolution  is  measured  with  the  checkerboard  patterns,  it  is  more  sensitive 
to  the  effects  of  noise  than  when  it  is  measured  with  three-bar  patterns. 
Consequently,  the  last  result  mentioned  suggests  that  noise  was  an  important 
determinant  of  the  observer's  recognition  performance. 


Williams  and  Erickson's  last  experiment  used  dynamic  imagery,  but 
manipulated  the  same  variables  used  in  the  second  experiment.  There  was, 
however,  a  critical  difference;  The  noise  manipulation  was  defined  in 
terms  of  dynamic,  non-fixed- pattern  noise;  that  is,  although  the  noise  level 
on  each  image  frame  was  the  same,  its  pattern  differed. 

The  results  of  this  experiment  were  highly  consistent  with  those  of  the 
second  experiment,  with  this  notable  exception;  Compared  with  the  recogni¬ 
tion  accuracy  of  the  second  experiment,  mean  recognition  accuracy  improved 
8%  on  the  average,  at  each  level  of  noise  when  the  noise  was  dynamic. 
Furthermore,  when  no  noise  was  present  in  the  imagery,  there  was  virtually 
no  difference  in  overall  recognition  accuracy  for  the  static  and  dynamic 
imagery.  Thus,  Williams  and  Erickson  conclude  that,  "The  results  indicate 
a  degree  of  equivalence  and  provide  a  basis  for  extending  experimental 
results  from  static  imagery  to  systems  of  dynamic  imagery"  (p.  116).  With 
respect  to  signal- to- noise  data  collected  on  static  imagery,  they  might  have 
added  that  this  data  may  lead  to  an  underestimation  of  what  is  achievable 
operator  performance. 

Aside  from  the  behavioral  effects  of  static  versus  dynamic  noise,  what  is 
of  note  here  is  that  many  of  the  important  results  discussed  in  the  previous 
sections  are  also  represented  in  Williams  and  Erickson's  data;  target 
recognition  performance  depended  upon  the  raster  density  and  the  level  of 
noise,  performance  was  relatable  to  the  system's  modulation  transfer 
function  in  the  direction  of  the  scan,  and  the  effects  of  noise  could  be 
compensated  for  by  increased  resolution  (overscanning). 

This  approximates  the  effect  of  doubling  the  signal- to- noise  ratio  (Williams 
and  Erickson,  1976). 


SECTION  II 


THE  EMPIRICAL  EVALUATION  OF  A  FIRST-  AND 
SECOND-GENERATION  FLIR  IMAGING  SYSTEM 

INTRODUCTION 

The  review  of  the  operator  performance  literature  reveals  that 
system  resolution  (defined  in  terms  of  raster  structure  and  spatial  frequency 
modulation  in  the  direction  of  the  raster  scan),  system  sensitivity  (here 
discussed  in  terms  of  the  system's  signal- to-noise  ratio),  and  their  inter¬ 
action  influence  operator  performance  on  detection,  recognition,  and 
identification  tasks.  It  has  been  shown  as  well  that,  with  respecl  to  one  or 
the  other  of  these  parameters,  a  point  can  be  reached  beyond  which  further 
improvements  in  system  resolution  and  system  sensitivity  no  longer  lead 
to  improved  operator  performance,  [n  light  of  the  asymptotic  and  tradeoff 
relationships  inherent  in  these  system  resolution  and  system  sensitivity 
parameters,  it  is  important  to  determine  what  improvements  in  operator 
performance  might  result  from  projected  FLIR  system  designs  and  to 
compare  them  with  operator  performance  measures  obtained  from  current 
FLIR  systems. 

In  the  research  reported  below,  a  first- generation  FLIR  system  and  a 
second- generation  FLIR  system  are  simulated  and  evaluated.  One  question 
of  interest  is  whether  or  not  the  increased  resolution  and  sensitivity  of 
the  second-generation  FLIR  system  will  significantly  better  the  target 
detection  and  target  recognition  performance  of  human  operators.  In 
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order  to  answer  this  question,  target  detection  and  target  recognition  data 
were  collected.  These  data  were  used  to  plot  the  minimum  resolvable 
temperature  (MRT)  functions  for  each  system  under  each  decision  criterion. 

The  specific  experimental  procedure  for  obtaining  MRTs  is  that  the  target 
temperature  generating  and  sensing  equipment  is  calibrated  to  measure  T 
to  an  accuracy  of  at  least  0,  05°C.  The  room-ambient  illumination  is 
approximately  30  fc  and  back  reflection  of  the  laboratory  seen  by  the 
collimator  is  minimized.  Four  or  five  observers  with  good  visual  acuity 
(corrected  if  necessary)  and  normal  color  vision  are  used.  The  target 
must  have  a  signal-to-noise  ratio  large  enough  so  the  noise  is  negligible. 

An  oscilloscope  is  connected  to  the  amplified  output  of  the  channel  that  is 
scanning  the  target.  The  optical  focus  of  the  infrared  sensor  is  adjusted 
for  peak  signal  on  the  oscilloscope.  Display  controls  are  adjusted  to 
establish  an  operating  point  by  selecting  a  brightness  and  contrast  setting 
that  corresponds  to  a  point  on  a  linear  portion  of  the  system's  intensity 
transfer  characteristic  and  for  which  noise  is  just  discernible  on  the  display. 
This  setting  and  focus  setting  remain  fixed  throughout  the  test.  The  T  of 
the  target  is  set  low  enough  so  that  no  observer  can  resolve  the  target  and 
increases  at  a  rate  low  enough  to  insure  thermal  uniformity.  Each 
observer  notes  the  temperature  difference  at  which  he  can  reliably  resolve 
the  target.  The  MRT  is  defined  as  that  temperature  at  which  a  majority  of 
observers  can  resolve  the  target  with  certainty. 

Typically,  MRT  functions  are  obtained  using  the  psychological  techniques 
known  as  the  method  of  limits  (Biberman,  1971;  Decker,  1976).  In  this 
procedure,  an  observer  is  presented  with  a  known  series  of  stimuli  in 
which  the  signal  strength  of  successive  stimuli  is  either  increasing  or 
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decreasing  (depending  whether  the  stimuli  constitute  an  ascending  or 
descending  series,  respectively)/  During  the  presentation  of  a  stimulus 
the  observer  indicates  whether  or  not  he/she  can  detect  it.  From  the  data 
obtained,  the  signal  strength  required  to  attain  a  particular  level  of  per¬ 
formance  (typically  50%)  is  determined. 

Decker  (1976)  has  disputed  the  validity  of  MRT  data  collected  using  the 
method  of  limits.  He  argues  that  they  are  subject  to  the  effects  of  observer 
bias  and  to  differences  in  interpretation  of  the  required  task.  Furthermore, 
when  Decker  compares  recognition  data  he  collected  using  the  method  of 
limits  with  comparable  data  he  collected  using  a  more  objective  forced- 
choice  methodqlogy/he  finds  that  ",  .  .  relative  to  the  thresholds  produced 
by  the  forced- choice  method,  the  method  of  limits  yields  lower  thresholds 
when  image  quality  is  good  and  higher  thresholds  when  image  quality  is  poor" 
(Decker,  1976,  p.  14).  In  light  of  these  results.  Decker  advocates  use  of 
the  more  objective  technique  (in  this  case,  the  forced- choice  procedure). 

This  is  significant  for  the  research  reported  below  insofar  as  a  modified 
forced- choice  methodology  was  used.  As  modified,  the  procedure  permits 
one  to  collect  detection,  as  well  as  recognition,  data. 

Aside  from  the  empirical  evaluation  of  operator  performance  for  first-  and 
second-generation  FLIR  systems,  there  is  a  second  purpose  for  the  present 


MRT  measurements  typically  use  only  ascending  series, 
t 

In  Decker's  forced-choice  situation  stimuli  are  presented  in  a  random, 
rather  than  a  serial,  order  and  the  observer  is  forced  to  make  one  of  a 
fixed  number  of  responses  to  each.  Since  Decker  (1976)  was  obtaining 
recognition  data,  subjects  had  to  indicate  whether  the  bar  pattern  stimuli 
he  presented  were  oriented  horizontally  or  vertically. 
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research.  The  research  was  designed  to  evaluate  the  Night  Vision  Labora¬ 
tory's  (NVL)  recognition  and  detection  model.  This  model,  formulated  by 
Ratches  and  his  associates  (Ratches,  Lawson,  Obert,  Bergemann,  Cassidy, 
and  Swenson,  1975),  has  been  widely  accepted  for  evaluating  FLIR  imaging 
systems  and  has  proved  to  have  predictive  value  for  target  detection  and 
recognition  performance  that  other  suggested  figures  of  merit  have  yet  to 
achieve  (Johnson  and  Lawson,  1974;  Ratches,  Lawson,  Obert,  Bergemann, 
Cassidy,  and  Swenson,  1975).  It  also  has  the  advantage  of  being  based  upon 
parameters  that  are  specific  to  FLIR  imaging  systems,  notably  the  MRT 
function  (which  reflects  aspects  of  system  resolution  and  system  sensitivity 
that  have  been  shown  to  influence  operator  performance)? 


In  this  regard  it  may  prove  to  be  less  limited  in  predicting  performance  for 
individual  targets  than  modulation- transfer-function-based  measures. 

A  second  kind  of  measure  has  also  been  developed  (Rosell  and  Willson,  1973; 
Sendall  and  Rosell,  1973).  Referred  to  as  the  SNRD  (the  signal- to- noise  ratio 
of  the  display),  it  is  based  upon  the  video's  signal- to-noise  ratio,  but  is 
adjusted  in  order  to  take  into  account  the  video  bandwidth  and  the  spatial  and 
temporal  integration  effects  of  the  human  operator's  eve.  As  Jones,  Freitag, 
and  Collyer  (1974)  point  out,  it  has  already  proved  useful  for  characterizing 
the  Johnson  criteria  in  terms  of  the  physical  parameters  of  the  system,  the 
target,  and  the  environment;  therefore,  it  is  readily  adapted  to  a  FLIR 
system.  So  far,  however,  in  comparison  to  the  NVL  model,  a  signal- to- noise- 
based  metric  has  been  shown  to  make  less  successful  predictions  (Johnson 
and  Lawson,  1974). 

*  Through  the  use  of  delta-T  at  the  sensor,  the  NVL  model  also  takes  into 
account  the  atmospheric  conditions  that  can  limit  an  infrared  system's 
performance.  This  makes  the  model  particularly  relevant  to  a  FLIR 
system's  use  in  Europe. 
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Beyond  the  intrinsic  usefulness  of  validating  the  NVL  model,  the  evaluation 

of  its  predictiveness  for  the  FLIR  systems  simulated  in  this  experiment 

seems  justified  in  light  of  the  validation  results  obtained  by  Decker  (1976). 

Decker  used  his  recognition  data  to  assess  the  validity  of  five  target 

acquisition  models,  among  which  was  the  NVL  model.  He  found  that  no 

model's  predictions  agreed  very  well  with  either  the  recognition  data  he 

* 

obtained  or  with  one  another.  He  also  found  that  in  all  cases  the  amount 
of  disagreement  between  the  data  and  a  model's  predictions  varied  as  a 
function  of  the  image  quality.  Given  the  image  quality  differences  that  are 
likely  to  result  from  the  improved  capabilities  of  a  second-generation  FLIR 
system  relative  to  those  of  a  first-generation  system,  the  validation  of  the 
NVL  model  for  the  simulations  undertaken  here  is  warranted/ 


*However,  by  using  linear  regression  techniques.  Decker  (1976)  did  find 
that  ".  .  .  the  MRT's  spatial  frequency  dependence  was  most  accurately 
predicted  by  the  SNRD-based  equations  [which  he  takes  the  NVL  model  to 
be]  for  the  noisy  image  quality  conditions  and  by  the  "exponential"  equation 
[of  Moser- -see  Decker,  1976 
images"  (p.  21). 

+Along  these  lines.  Decker  (1976)  notes. 

There  is  significant  variability  among  MRT  models,  primarily  in 
a  linear  scale  factor.  Therefore,  one  should  not  only  be  careful 
in  the  selection  of  the  best  model,  according  to  the  MTF/noise 
characteristics  of  the  system  under  consideration,  but  should  also 
validate  the  model  as  well  as  can  be  done  and  provide,  in  this  way, 
the  best  scale  factor  for  the  particular  system  (p.  22). 
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SIMULATION  OF  FLIR  SENSORS 


2 

Introduction:  Scaling  the  International  Imaging  System  (I  S) 

Model  70/  E  to  Simulate  Two  FLIR  Systems' 

The  traditional  FLIR  display  study  by  laboratory  simulation  typically  uses 

prepared  target  slides,  a  light  box,  a  high-quality  TV  camera  and  CRT 

monitor,  a  Guassian  noise  generator,  and  a  variable  bandpass  filter  to 

generate  displayed  imagery  which  simulates  many  different  FLIR  sensor 

and  scene  conditions.  However,  this  analog  approach  to  FLIR  simulation  no 

longer  provides  the  precision  and  control  required  to  make  the  necessary 

2 

fine  evaluations;  therefore,  the  digital  I  S  Model  70/ E  imaging  system  was 

2 

used  for  this  simulation.  The  I  S  Model  70/ E  image  system  is  a  flexible 
image  array  processor  based  on  the  LSI- 11  microprocessor  in  which  N-bit 
512  x  512  images  can  be  manipulated  and  displayed  at  video  frame  rates. 

The  number  of  bits  per  pixel  (N)  may  be  field  configured  to  any  value  from 
1  to  8  bits.  This  system  has  the  capability  to  simulate  any  FLIR  imaging 
system  and  provides  the  user  with  enough  flexibility  and  control  to  define 
precisely  such  parameters  as  the  MTF  function,  noise  characteristics  and 
distribution,  rastering,  and  target  size  and  position.  Another  advantage  of 
the  I  S  simulation  over  other  FLIR  performance  prediction  models  and/or 
techniques  is  that  the  observer's  eye/ brain  temporal  integration,  spatial 
filtering,  and  brightness  sensitivity  need  not  be  modeled,  avoiding  the 

2 

requirement  to  model  a  mechanism  that  is  not  clearly  understood.  The  I  S 

simulation  substitutes  the  human  observer  for  equations  that  model  the 

human  response,  such  as  those  used  by  the  Night  Vision  Laboratory  s  FLIR 

performance  model.  This  introduction  presents  the  calculations  used  to 
2 

scale  the  I  S  imaging  system  to  the  currently  operational  and  second- 
generation  FLIR  systems  being  simulated. 


o 

The  I  S  system  simulates  (1)  the  image  degradation  induced  in  the  line  bar 

2 

pattern  by  the  system  transfer  function  and  (2)  the  noise.  The  I  S  modeling 
assumes  that; 

1.  The  FLIR  sensor  is  operating  in  the  linear  portion 

of  its  response  so  that  the  target  can  be  described  by 
the  MTF  of  the  system. 

2.  The  electronic  processing  and  the  monitor  are  noiseless. 

3.  The  system  is  relatively  simple  with  a  well-behaved  MTF 
and  a  well-behaved  noise  power  spectrum. 

4.  The  image  formation  is  spatially  invariant  in  the 
scanned  direction. 

The  system  transfer  function  of  the  various  system  components,  which 
include  optics,  spatial  detector  response,  electronic  detector  response, 
amplifier  response,  and  the  response  of  the  display,  meets  the  above 
requirements  for  the  FLIR  sensor.  The  transfer  function  of  the  system 
is  the  product  of  the  component  transfer  functions. 

It  is  assumed  that  the  FLIR  detector  output  is  biased  and  AC-coupled  such 

that  a  signal  proportional  to  the  difference  in  temperature  between  the  hot 

2 

and  cold  test  bars  is  passed  linearly  through  the  system.  The  I  S  simulation 

then  models  this  signal  transfer  through  the  system.  The  first  function 
2 

performed  on  the  I  S  is  the  generation  of  the  degraded  line  stimulus.  This 

imagery  is  generated  by  taking  the  convolution  of  the  line  spread  function 

of  the  system  with  the  square  wave  line  bar  pattern  at  various  spatial 

2 

frequencies.  The  line  spread  function  is  computed  outside  of  the  I  S 
simulation  by  the  fast  Fourier  transform  of  the  system  MTF.  The  line 
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spread  function  is  entered  into  the  I  S  storage  as  an  amplitude  function  vs 

the  number  of  pixels  and  is  scaled  from  the  line  spread  function  in  object 

space  to  image  space.  The  unit  of  the  line  spread  pixel  spacing  is  the 

fractional  amount  of  the  sensor  picture  width  (in  image  space).  This 

frequency  is  franslatable  into  the  spatial  frequency  in  object  space  in  units 

2 

of  cycles  per  mrad.  The  parameters  that  are  varied  in  the  I  S  simulation 
are  the  amplitude  of  the  line  bar  pattern  and  its  spacing  in  image  space, 
which  represents  a  spatial  frequency  in  object  space  as  well. 

2 

The  second  function  performed  in  the  I  S  simulation  is  the  reduction  of  the 
noise-equivalent  temperature  by  the  transfer  function  of  the  display.  The 
noise-equivalent  temperature  difference  (NEAT)  is  defined  as  that  input 
temperature  difference  for  a  large  target  (a  large  target  being  one  whose  size 
is  large  relative  to  the  system  response  function)  which  is  required  to  gener¬ 
ate  a  signal  (voltage  amplitude)  just  prior  to  display  (or  after  the  detector 
preamplifier).  This  is  just  equal  to  the  RMS  noise  (voltage)  at  that  point, 
assuming  that  the  filtering  action  of  the  electronics  prior  to  the  measurement 
point  corresponds  to  that  of  a  standard  filter.  There  is  some  ambiguity  in 
this  definition  of  NEAT.  The  NEAT  is  not  directly  related  to  signal- to- noise 
ratio,  which  is  fundamental  for  perception  of  targets  on  a  display.  It  is  also 
not  a  display  noise.  It  is  a  point  noise  figure  rather  than  a  noise  averaged 
over  the  target.  However,  the  NEAT  is  a  useful  indication  of  system 

sensitivity  and  is  used  to  simplify  MRT  and  MDT  performance  predictions 

2 

in  a  number  of  models  such  as  this  simulation.  The  I  S  simulation  accepts 

the  NEAT  or  white  noise,  that  is,  noise  which  is  flat  with  respect  to  the 

spatial  frequency.  The  display  transfer  function  filters  this  noise  before  it 

2 

is  imaged  on  the  display.  Consequently,  the  I  S  simulation  performs  the 
convolution  of  the  display  line  spread  function  with  the  RMS  noise-equivalent 
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temperature  difference  and  presents  this  noise  on  the  display.  This 

2 

noise  remains  constant  throughout  the  I  S  simulation  tests  for  various 
amplitudes  of  the  bar  pattern  temperature  difference  and  variance  in  spatial 
frequencies. 

2 

The  performance  of  the  I  S  simulation  is  compared  with  the  Night  Vision 
Laboratory  (NVL)  static  performance  model  for  thermal  viewing  systems. 

This  computer  model  predicts  the  static  detection  and  recognition  performance 
of  electro- optical  imaging  systems  sensitive  to  the  3  to  5  and  8  to  14  urn 
waveband.  This  model  was  developed  at  NVL  to  aid  in  the  evaluation  of 
designs  for  IR  systems  for  Army  missions  encompassing  surveillance  and 
target  acquisition  systems  and  missile,  tank,  airborne,  and  air  defense 
applications.  The  model  mathematically  simulates  the  real-world  target, 
atmosphere,  device,  and  observer.  It  also  calculates  the  subjective  detecta¬ 
bility  or  recognizability  of  a  target.  A  relatively  simple  method  is  used  to 
represent  the  target  atmosphere  and  MTF,  NEAT,  MRT,  and  MDT  equations 
for  the  device.  The  subjective  decision-making  behavior  of  the  human  is 
derived  empirically  from  the  existing  field  of  laboratory  perception  data. 

The  device  and  eyeball  are  represented  in  the  MTF,  NEAT,  MRT,  and  MDT 

2 

calculations  and  are  straightforward,  although  extensive.  The  I  S 
simulation  results  are  expressed  in  terms  of  the  MRT  response  and  compared 
with  the  MRT  values  derived  by  the  NVL  model. 

2 

Target  Bar  Temperature  and  Noise  Scaling  to  TS  Pixel  Storage 


2 

The  512  x  512  pixel  I  S  system  will  simulate  bar  imagery  within  a  1.0  in. 

x  1.0  in.  central  portion  of  a  6  in.  x  8  in.  FUR  display.  The  512  pixels 
2 

of  the  I  S  system  will  in  turn  drive  an  8  in.  by  8  in.  portion  of  a  1  3  in. 

10  in.  monitor  viewed  at  a  distance  of  120  in,  to  simulate  viewing  of  the 
1.0  in.  x  1.0  in.  central  portion  of  a  FLIR  display  at  a  15  in.  distance. 
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2 

Our  approach  to  scaling  the  I  S  display  to  a  FLIR  system  was  to  equate  the 
8-in.  wide  FLIR  display  to  the  horizontal  FOV  of  the  FLIRs  to  bo  simulated. 
Therefore  the  1.0  in.  x  1.0  in.  FLIR  display  viewed  at  15  in.  (or, 
equivalently,  8  in.  x  8  in.  display  at  120  in. )  will  represent  1/8  of  the 
horizontal  angular  FOV  of  the  sensor  or  1/8  of  the  picture  width  (PW)  of 
the  FLIR  display. 

An  8-in.  FLIR  display  at  a  distance  of  15  in.  subtends  an  angle  6,  where 
9=2  Tan  *(4  in.  / 1 5  in.  )  =  29.  863  deg  =  1791. 8  arc-min 


The  spatial  frequencies  of  the  one-  and  four-bar  patterns  for  targets  1  to  6  are 

2 

listed  in  Table  17.  These  bar  patterns  are  the  basis  for  the  I  S  MRT 
simulation,  along  with  an  rms  noise  level.  The  rms  noise  levels  for  FLIRs 
1  and  2  are  0. 182K  and  0.  053K  and  are  used  to  scale  the  simulation  of  the 
MRT  measurements.  The  MRT  is  the  minimum  resolvable  temperature 
difference  between  the  bar  and  background  as  viewed  on  the  display. 

Figures  18a  and  18b  show  the  MRT  function  versus  spatial  frequency  for 
FLIRs  1  and  2,  respectively.  Our  FLIR  simulation  used  values  close  to  the 
MRT  value  listed  in  Table  17  since  this  value  is  the  temperature  at  the 
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TABLE  17.  TARGET  BAR  SPATIAL  FREQUENCY  AND  MRT  FOR  FLIR  1  and  FLIR  2 


t  in  m  m  m  m 
zirm 


Figure  18b.  Predicted  MRT  for  FLIR  2 


threshold  of  detection,  that  is,  at  the  point  "where  one  of  two  observers 
sees  a  discernable  pattern.  " 


It  should  be  noted  that  the  spatial  frequencies  for  target  1  for  both  FLIR  1 
and  FLIR  2  are  too  high  for  consideration.  Consequently,  the  corresponding 
MRT  values  are  too  high  to  be  of  interest  and  cannot  be  easily  measured  for 
most  sensor  applications. 


2 

The  amplitude  of  the  noise  stored  in  the  I  S  system  and  the  display  gain  was 
adjusted  such  that  the  noise  was  just  discernable  on  the  display .* 


Number  of  I  S  Pixels  vs 


Target  Bar  Width 


2 

The  I  S  system  was  scaled  to  simulate  a  1.0-in.  wide  display  with  512 
pixels  at  a  viewing  distance  of  15  in.  The  angle  6  subtended  by  1.0  in.  at 
15  in.  is: 


e  =  2  Tan 


1 , 0  in. / 2 
15  in. 


*  229.  1  arc-min 


Honeywell  RPV  FLIR  Sensor  Proposal,  pp  12-16. 
^Biberman,  1971,  p.  35. 
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The  number  of  pixels  per  angle  bar  width  T1  is 

•n  -  en/ pixels  ^  bar  width  (arcrmin/l 
1  “  \display  J  <  7 - *-  'J 


bar  width  (arc~min/bar  width) 
229.  1  (arc-min/display) 


512  x  bar  width 


229 


The  number  of  pixels  and  bar  width  for  each  of  the  six  targets  are  shown  in 
Table  18. 


TABLE  18.  NUMBER  OF  l  S  PIXELS  PER  BAR  WIDTH 


Target 

Number 


Number  of 
512  Pixels 


Bar  Width 
(arc  min) 


6 


FLIR  1;  Line  Spread  Function 

2 

The  fast  fourier  transform  (FFT)  was  performed  on  the  I  S  system  modula¬ 
tion  transfer  function  (MTF)  for  the  two  FLIRS  to  permit  convolution  of  the 
system  line  spread  function  with  the  simulated  target  bar  pattern  amplitudes. 
The  FFT  of  the  MTF  for  FLIR  1  (Figure  19)  was  taken  over  N  =  128  points. 
The  spatial  frequency  increment  was  F  =  0.  5c/mrad.  The  relationship  of 
the  FFT  spatial  frequency  increment  FFT  input  (Table  19)  to  the  distance 
increment  FFT  output  of  the  line  spread  function  is  given  by: 


TABLE  19.  FLIR  1;  MTF  DATA  FOR  THE  FFT 


FFT  I"  F  "  °* 
l  N  =  !2 


0.  5c/mrad 
128  points 


Spatial  Frequency 
cl  PW 

Spatial  Frequency 
(c/mrad) 

MTF 

0 

0.00 

1.000 

30 

0.  50 

0.  903 

60 

1.00 

0.  754 

90 

1.50 

0.606 

120 

2.00 

0.481 

1  50 

2.  50 

0.373 

180 

3.00 

0.266 

21  0 

3.  50 

0.  154 

240 

4.  0 

0.063 

270 

4.  5 

0.017 

300 

5.0 

0.000 

The  units  of  the  line  spread  function  should  be  in  fractions  of  the  picture 
width  (PW).  The  PW  is  3.  5  deg  x  17.45  or  61.  08  mrad/PW.  The  line  spread 
function  increment  expressed  as  a  fraction  of  PW  is  then: 

increment  /mrad /increment^ 


PW  ^  mrad/PW  J 

0.01563  mrad/ increment 
61.08  mrad/PW 

3  0.0002558  PW/increment  (total  increment  across  display:  3,  909.3) 
The  line  spread  function  of  FLIR  1  is  shown  in  Table  20. 
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TABLE  20.  FLIR  1:  LINE  SPREAD  FUNCTION  FOR 
40  POINTS  FROM  THE  FFT 


Unit  Increment  (X)  *  2.  558  x  10  PW/ cycle 


FLIR  1;  Conversion  of  Line  Spread  Increments 


-4 

The  line  spread  function  increment  in  fraction  of  PW  is  2.  558  x  10  PW. 

2 

Equivalently,  there  are  3909. 12  increments  per  picture  width.  The  I  S 
system  uses  512  pixels  to  simulate  1.0  in.  of  the  FLIR  display  (that  is, 
1/8  of  the  8-in.  picture  width).  The  FFT  increment  represents: 


_1 

8 


x 


3909. 12 


increments 

PW 


=  488.  64  increments  over  1/8  of  simulated  display 

2 

across  the  simulated  1.0- in.  FLIR  display.  Since  the  I  S  system  requires 
512  pixels  or  amplitude  points  across  the  1.0-in.  FLIR  display,  instead  of 
the  488.64  FFT  points,  28  FFT  increments  (in  other  words,  29  FFT  points) 
were  used  to  represent  one  half  of  the  line  spread  function.  This  scales  to: 

512 

■  x  28  *  29.34  increments 

488. 64 


A  program  was  used  to  linearly  interpolate  30  points  scaled  to  the  I  S 
simulation,  representing  a  1.0-in.  portion  of  an  8-in.  wide  display  by  using 
29  points  from  the  line  spread  function.  The  ratio  for  increment  interpolation 
is  488.64/512  ■  0.9544.  This  data  is  presented  in  Table  21.  A  linear  inter¬ 
polation  is  accurate  in  this  case  since  the  line  spread  function  for  FLIR  1 
is  linear  from  increment  2  through  increment  13  and  the  amplitude  is  low 
beyond  increment  14  (see  Figure  3). 


If  the  525-TV-line  FUR  1  system  has  approximately  384  active  raster  lines 
across  the  vertical  display  height  of  6  in.  (3/4  aspect  ratio),  then  a  1.0-in. 
simulated  vertical  portion  of  the  display  will  have: 

x  384  raster  lines 

6.  0  in. 

=  64  raster  lines 

2 

Consequently,  the  I  S  system  will  use  eight  pixels  to  simulate  the  energy 
distribution  of  a  CRT  spot;  that  is,  8  x  64  *  512  pixels. 

FLIP  2;  Line  Spread  Function 


The  distance  increment  X  of  the  line  spread  function  for  FLIR  2  was 

calculated  in  the  same  manner  as  for  FLIR  1.  However,  different  values 

for  N  and  F  were  used.  The  FFT  of  the  MTF  for  FLIR  2  was  taken  over 

N  =  256  points.  The  spatial  frequency  increment  was  F*  1.0  cvcle/mrad. 

The  increment  of  line  spread  function  is  X  *  0.  0039063  mrad/c.  The  PW 

for  FLIR  2  is  1.7  dee  x  1  7.  45  -  29.  66  mrad.  Consequently,  the  increment  of 

-4 

line  spread  function  in  fractions  of  picture  width  is  1.3168  x  10  PW  (in 
image  space). 


A  standard  TV  line  scan  system  has  480  to  490  active  scan  lines;  however 
FLIR  1  has  approximately  384  active  scan  lines.  Consequently,  the 
vertical  CRT  picture  height  is  expanded  to  preserve  the  3:4  aspect  ratio, 
thus  creating  some  distortion  in  the  displayed  image  (see  pg.  116). 
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FLIR  2;  Conversion  of  Line  Spread  Increments 


-4 

The  PW  increment  for  FLIR  2  is  1.  3168  x  10  PW,  which  is  equivalent  to 

7594.24  increments  across  the  simulated  8-in.  width  of  the  FLIR  display 

o 

(or  949.28  points  across  1.0  inch).  The  I  S  requires  512  points  and  32  FFT 

increments  were  used  to  represent  half  of  the  line  spread  function  (see 

2 

Table  22).  Therefore,  the  required  scale  for  the  I  S  simulation  is: 


512 

949.28 


x  32  ■  17.2594  increments 


2 

The  ratio  of  large  increment  (I  S)  to  small  increment  (FFT  output)  is 

2 

1.8541.  Therefore,  to  get  17  increments  for  I  S,  33  FFT  increments  are 

needed.  Table  23  presents  the  FFT  printout  over  34  points  and  the  interpolated 

2 

18  points  of  the  line  spread  function  scaled  to  the  512  point  I  S  system. 


FLIR  2  is  an  875-TV-line  system  with  an  estimated  768  active  raster  lines 

across  the  vertical  display  height  of  6.0  in.  (3/4  aspect  ratio).  This  yields 

128  raster  lines  across  the  1.0-in.  simulated  vertical  portion  of  the  display. 

2 

Therefore,  four  vertical  lines  of  the  512-pixel  I  S  system  were  used  to 
simulate  the  CRT  spot  energy  distribution;  that  is,  4  x  128  =  512  pixels. 
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TABLE  23.  FLIR  2:  INTERPOLATED  FFT  POINTS 
SCALED  TO  I2S  SYSTEM 


34  FFT 

Points 

18  Interpolated  Points 

1 

19.350 

1 

19.350 

2 

19.032 

2 

18.237 

3 

18. 101 

3 

15.256 

4 

16.621 

4 

11.090 

5 

14.694 

5 

6.629 

6 

12.449 

6 

2. 727 

7 

10.033 

7 

-0.009 

8 

7.  595 

8 

-1.331 

9 

5.276 

9 

-1.367 

10 

3.  193 

10 

-0.611 

11 

1.455 

11 

0.413 

12 

0.107 

12 

1.232 

13 

-0.322 

13 

1. 726 

14 

-1.342 

14 

1. 693 

15 

-1.494 

15 

1.310 

16 

-1.342 

16 

0.  766 

17 

-0.965 

17 

0.260 

18 

-0.450 

18 

-0.096 

19 

0.  120 

20 

0.  671 

21 

1.  143 

22 

1.496 

23 

1.709 

24 

1.778 

25 

1.  716 

26 

1.  546 

27 

1.299 

28 

1.010 

29 

0.  709 

30 

0.42  5 

31 

0. 177 

32 

-0.022 

33 

-0.165 

34 

-0.254 

Noise  and  Spot  Size  Simulation 


The  512-X-512  I  S  pixel  noise  storage  represents  the  display  noise  before 
it  is  filtered  by  the  system  MTF  (convolved  with  system  line  spread  function), 
therefore,  to  determine  how  the  noise  should  be  simulated,  it  is  necessary 
to  evaluate  the  noise  generation  characteristics  of  the  viewed  FLIR  display. 


FLIR  1  has  a  vertical  overscan  (OVERSC)  of  1.98.  OVERSC  is  defined  as: 

IFOV 


OVERSC  = 


vert 


raster  spacing 
Solving  for  the  space  between  detector  scan  lines. 


IFOV 


raster  spacing  = 


vert 


OVERSC 

0.  236  mrad 
1.98 

=  0. 1192  mrad 

Therefore,  the  number  of  active  scan  lines  is: 

VFOV 


active  scan  lines  = 


raster  spacing 


2. 6  deg  x  17. 45  mrad/deg 
0.1192 


384  active  scan  lines  across  the 
vertical  display  height  of: 

Li^ef  x8in‘  =  6*0in* 
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The  noise  was  generated  over  384  lines  per  frame  with  a  4:1  interlace  and 

a  1.98  vertical  scan  overlap.  The  overlap  refers  to  the  detector  1FOV  in 

object  space.  Notice  that  the  overlap  is  greater  than  the  raster  spacing. 

This  means  that  the  detector  sees  the  target  twice  during  a  frame.  However, 

if  it  is  assumed  that  the  display  CRT  spot  diameter  is  set  equal  to  the  raster 

spacing,  then  the  target  signal  in  object  space  is  integrated  twice  but  noise 

downstream  from  the  detector  is  not  integrated.  The  noise  originates  at  the 

output  of  the  detector,  not  in  object  space.  Therefore,  the  noise  is  only  cor- 

2 

related  from  pixel  to  pixel  of  the  I  S  in  the  horizontal  direction  over  the  width 
of  the  line  spread  function  and  is  not  correlated  from  raster  line  to  raster  line. 

2 

With  the  I  S  system  scaled  to  FLIR  1,  there  are  64  raster  lines  across  the 

2 

vertical  display  height.  Therefore,  the  noise  stored  on  the  I  S  should  be 
correlated  over  512/64  *  8.0  vertical  lines.  These  eight  lines  correspond 
to  the  width  of  the  CRT  spot.  The  intensity/amplitude  of  the  noise  was 
varied  across  the  spot  width  to  simulate  spot  intensity. 

Gaussian  CRT  Spot  Distribution 


A  Gaussian  spot  distribution  was  assumed  for  the  CRT  display  spot  intensity. 

Spot  cutoff  was  defined  as  the  shrinking  raster  with  e  *  amplitude  at  a 
distance  W  from  the  spot  center  (Figure  20). 

The  normalized  amplitudes  for  a  four- line  and  an  seight-line  display  spot 
simulation  are  presented  in  Table  24. 

Figure  21  presents  the  display  spot  amplitude  distribution  that  was  simulated 
2  - 1 

by  the  I  S  pixel  amplitude  storage  with  an  e  amplitude  cutoff  point.  Figure  22a. 
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w2 
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AT  X  -  W  =  1.0 


Figure  20.  Gaussian  CRT  Spot  Distribution 
TABLE  24.  NORMALIZED  INTENSITY  AMPLITUDE  DISTRIBUTION 


Four-Point  CRT  Spot/FLIR  2 

Eight- Point  CRT  Spot/FLIR  1 

X/\V 

I 

X/W 

I 

±.3333 

.895 

±  .1429 

.980 

1.0000 

.  368 

±  .  4286 

.  8322 

±  .7143 

.  600 

1.0000 

.  368 
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SHRINKING  RASTER  -  SPOT  DIAMETER  OF 
•-1  AMPLITUDE 


CRT  SPOT  RADIUS 

Figure  21.  CRT  Spot  Simulation:  Amplitude  vs  No.  of  Points 

shows  that  the  four-line  spot  simulation  (for  FLIR  2)  represents  a  display 
raster  scan  that  has  a  nearly  zero  intensity  amplitude  between  scans.  The 
eight-line  spot  simulation  represents  a  raster  that  has  a  0.369  amplitude 
between  scans  (see  Figure  2  2b). 

Line  Spread  Function  for  Noise  Convolution 

Figure  23  shows  the  extrapolation  of  known  MTF  data  from  the  FLIR  1 

display  (for  a  spatial  frequency  of  five  where  the  system  MTF  cuts  off).  The 

tabulation  of  the  line  spread  function  of  the  display  is  shown  in  Table  25 

2 

for  both  the  FFT  output  and  interpolated  points  for  the  512  I  S  digital  display. 
These  points  represent  one  side  of  the  display  line  spread  function  for 
convolution  with  the  rms  detector  noise. 
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Figure  22.  Line  Spot  Simulation 


C/mrad 

Figure  23.  FLIR  Is  Display  and  System  MTF 

Table  26  shows  the  line  spread  function  tabulations  for  FLIR  2.  Both 
display  line  spread  functions  are  much  narrower  than  the  FLIR  sensor 
system  line  spreads  since  the  display  MTF's  are  much  better  (extend  over 
higher  spatial  frequencies).  However,  the  two  display  lines'  spreads 
have  about  the  same  width,  which  indicates  that  both  FLIRs  use  similar 
displays  (Conrac  with  2000  TV  line  resolution). 
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TABLE  25.  FLIR  1:  COMPUTER  OUTPUT  FOR  FFT  OF  DISPLAY  MTF 


The  29 

Data  Points  are: 

1 

43. 554 

2 

*33.  SIR 

3 

12. 776 

4 

- 1 . 593 

5 

-3.288 

6 

0.394 

7 

1.342 

H 

-0. 406 

9 

-0.977 

10 

0.  121 

11 

0.  586 

12 

0.  109 

13 

-0. 434 

14 

0.094 

15 

0.366 

LINK.  SPREAD  FUNCTION 

16 

0.021 

OF  DISPLAY  MTF  (FFT 

17 

-0.265 

OVER  128  POINTS) 

18 

0.  011 

19 

0.188 

20 

-0.044 

21 

-0. 184 

22 

0.035 

23 

0.  181 

24 

-0.003 

25 

-0.154 

26 

-0.019 

27 

0.  114 

28 

0.016 

29 

0.  082 

Increment  size  =  0.9544 

The  30 

Interpolated  Points  are; 

1 

43.554 

2 

33. 974 

3 

14.667 

4 

0.373 

5 

-2. 979 

6 

-0.445 

7 

1 . 083 

8 

0.  152 

9 

-0. 769 

10 

-0.330 

11 

0.374 

12 

0.240 

13 

-0.256 

14 

-0.221 

15 

0.191 

INTERPOLATED  FFT  POINTS 

16 

0.245 

SCALED  TO  l2S  SYSTEM  FOR 

17 

-0.OR7 

NOISE  CONVOLUTION 

18 

-0.203 

19 

0.043 

20 

0.  157 

21 

-0.056 

22 

-0.  175 

23 

0.034 

24 

0.174 

25 

0.  014 

26 

0.  133 

27 

0.044 

28 

0.083 

29 

0.043 

30 

*0. 050 

TABLE  26.  LINE  SPREAD  FUNCTION  OF  DISPLAY 
MTF  (FFT  OVER  256  POINTS) 


The  34  Data  Points  are; 


1 

39.374 

2 

37. 133 

3 

31.154 

4 

22.635 

5 

13.649 

6 

5.825 

7 

0.  42*1 

8 

-2.187 

9 

-2.417 

10 

-1.218 

11 

0.339 

12 

1.424 

13 

1.662 

14 

1.147 

15 

0.2  78 

16 

-0.485 

17 

-0.830 

18 

-0.700 

19 

-0.264 

20 

0.203 

21 

0.465 

22 

0.432 

23 

0.171 

24 

-0.146 

25 

-0.348 

26 

-0.342 

27 

-0.153 

28 

0.103 

29 

0.293 

30 

0.325 

31 

0.199 

32 

-0.011 

33 

-0. 195 

34 

-0.267 

Increment  Size  *  1.8541 


The  18  Interpolated  Points  are; 


1 

39.374 

2 

32.034 

3 

16.286 

4 

2.786 

5 

-2.283 

6 

-0.797 

7 

1.454 

8 

1.  158 

9 

-0.357 

10 

-0.  741 

11 

-0.011 

12 

0.452 

13 

0.092 

14 

-0.347 

15 

-0.161 

16 

0.2  57 

17 

0.241 

18 

-0. 107 

INTERPOLATED  FFT  POINTS 
SCALED  TO  l2S  SYSTEM 
FOR  NOISE  CONVOLUTION 
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METHODOLOGY 


Stimuli 


Equal  numbers  of  two  target  shapes --four-bar  and  solid  square- -were  used 
in  the  experiment.  Bar  width  was  1/7  of  bar  height.  Initially,  there  were 
six  different  target  sizes.  Five  levels  of  target  contrast  *  were  selected  for 
each  target  size  and  viewing  condition.  The  levels  were  chosen  in  pilot 
studies  which  bracketed  the  target  recognition  threshold  of  a  normal  observer. 
The  pilot  studies  indicated  that  the  smallest  target  could  not  be  recognized 
regardless  of  contrast.  Consequently,  it  was  excluded  from  the  main 
experiment. 

The  stimuli  were  convolved  with  a  line  spread  function.  Noise  was  then 
added  to  simulate  viewing  each  of  the  two  FLIRs  operating  at  three  noise 
levels.  The  resulting  images  appeared  as  blurred  versions  of  the  original 
target,  seen  against  a  background  of  dynamic  noise. 

Apparatus 


2 

Stimuli  were  computer-generated  with  the  I  S  Model  70  fE  image  analysis 
computer  interfaced  to  a  Honeywell  level  6/43  (digital)  computer.  The 
images  were  displayed  on-line  with  a  Tectronix  Model  632  television  picture 
monitor  using  standard  2:1  interlaced  composite  video  signals. 


*  ...  Target  Luminance  -  Background  Luminance 

on  ras  e  me  as  -j.arge);  Luminance  +  Background  Luminance 
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I 


Operators  viewed  the  display  from  a  distance  of  10  ft.  The  central  8  in.  x 
8  in.  portion  of  the  monitor  represented  a  1.0  in.  x  1.0  in.  area  of  a  FLIR 
display  viewed  from  15  in. 

Gain  and  brightness  levels  were  reset  prior  to  each  experimental  session. 

A  five- step  gray  wedge  was  displayed  on  the  screen  and  the  levels  adjusted 
to  yield  five  equally  spaced  luminance  steps  from  0.2  to  25  ft-L,  Luminances 
were  checked  with  a  Gamma  Scientific  telephotometer. 

Two  separate  video  channels  simulated  FLIR  MTF  and  noise.  The  test 
target  was  generated  on  one  channel;  then  the  system  MTF  for  either  FLIR  1 
or  FLIR  2  and  an  intensity  transform  were  applied,  producing  a  degraded 
image  at  the  desired  contrast.  With  the  second  channel,  noise  was  created 
line  by  line;  then  the  display  MTF  and  intensity  transform  were  applied. 

The  contents  of  the  two  channels  were  added  together  and  written  on  the 
monitor  at  the  rate  of  30  fps. 

The  noise  level  had  a  Gaussian  distribution  and  was  made  to  appear  dynamic 
by  randomly  selecting  an  (x,y)  offset  30  times  each  second  to  define  the  noise 
field  on  channel  two. 

Design 

A  repeated-measures  factorial  design  was  used.  All  possible  combinations 
of  shape,  size,  contrast,  MTF,  and  noise  levels  yielded  300  different 
stimuli.  Five  replications  of  each  target  yielded  a  total  of  1500  trials.  The 
targets  were  grouped  into  30  blocks  of  50  stimuli.  Each  block  maintained 
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constant  size,  MTF,  and  noise  levels,  simulating  an  observer  being  tested 
on  a  particular  FLIR  for  one  size  target.  Subjects  were  run  in  groups  of 
either  three,  four,  or  five. 

Trials  within  a  block  were  randomly  ordered.  Order  of  block  presentation 
was  randomized  across  subjects,  except  that  all  targets  representing  FLIR  1 
were  presented  first. 

Subjects 


Observers  were  males  between  the  ages  of  19  and  45.  All  were  required 
to  have  normal,  uncorrected  vision:  20/20  near  and  far  binocular  acuity, 
normal  stereopsis,  and  color  vision.  Assessments  were  made  with  a 
Titmus  Optical  Vision  Tester. 

Procedure 


Observers  viewed  the  display  binocularly.  Ambient  illumination  was 
maintained  at  0.5  ft-L.  A  20-minute  period  of  dark  adaptation  preceded 
testing. 

The  target  appeared  in  one  of  the  positions  on  the  display- -BO  pixels 
(10.3  mrad)  left  or  right  from  the  center  of  the  screen.  Trials  lasted  five 
seconds  and  were  followed  by  a  one- second  inter- trial  interval  during  which 
the  screen  appeared  homogeneous  at  the  background  luminance  level. 
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Subjects  were  instructed  to  watch  the  display  for  the  entire  five- second 
trial  interval  and  then  record  the  shape  and  position  of  the  stimulus  on 
their  answer  sheets.  They  were  instructed  to  give  their  best  guess  when 
uncertain.  See  Appendix  A  for  a  transcript  of  the  instructions  given  to  the 
subjects. 

Two  hundred  practice  trials,  with  feedback,  familiarized  observers  with 
the  stimuli  and  procedures.  The  30  test  blocks  followed.  A  five-minute 
break  was  allowed  after  every  nine  blocks.  The  experiment  required  about 
four  hours  to  complete. 

RESULTS 

Twelve  subjects  completed  the  experiment.  Responses  were  counted  as 
correct  detection  if  the  observer  indicated  the  correct  location  (left  or  right) 
of  the  target.  Responses  were  counted  as  correct  recognition  if  both 
location  and  target  identification  (four-bar  or  square)  were  accurate.  A 
third  category  of  correct  four-bar  recognition  was  based  on  correct 
identification  of  four-bar  patterns  conditioned  on  their  detection.  Trials 
on  which  a  detection  error  occurred  were  not  included  in  the  tabulation  of 
four-bar  recognition  responses. 

The  proportion  of  correct  responses  was  determined  for  each  of  the  above 
categories  under  all  30  viewing  conditions.  The  raw  data  from  which  these 
proportions  were  calculated  are  included  in  the  tables  in  Appendix  C.  The 
proportions  were  then  averaged  across  subjects. 


Figures  24  through  33  show  the  percentage  of  correct  detection  responses 
as  a  function  of  target  contrast  for  each  viewing  condition.  SIGNAL  TOP  is 
the  digital  pixel  value  of  either  the  four-bar  or  square  target  which  corres¬ 
ponds  to  the  peak  signal.  SIGNAL  BASE  for  all  conditions  was  200  (digital 
pixel  value).  All  noise  levels  used  for  a  given  combination  of  FLIR  MTF  and 
target  size  are  represented  in  the  same  graphs.  Noise  Levels  40,  80,  and 
160  digital  pixel  values  correspond  to  0.  033V,  0.  065V,  and  0.  130V  rms. 
Figures  34  through  43  and  44  through  53  show  the  same  information  for 
recognition  and  four-bar  recognition  responses,  respectively. 

The  75  percent  correct  point  was  interpolated  by  eye  for  each  four-bar 
recognition  and  detection  graph  and  considered  the  contrast  threshold.  For 
FLIR  1.  target  size  three  (250.9  cycles/PW),  the  threshold  was  approximated 
by  extrapolation  from  the  lowest  noise  condition.  The  same  was  achieved 
for  FLIR  2,  target  size  two  (401.7  cycles/PW).  These  approximations  are 
indicated  on  the  graph  by  asterisks. 

The  contrast  thresholds  for  four-bar  recognition  are  summarized  in 
Figures  54  and  55.  These  graphs  also  show  the  results  at  each  of  the  three 
noise  levels  for  each  FLIR. 

As  indicated  in  Figure  55,  the  thresholds  for  FLIP  1  monotonically  decreased 
with  increasing  target  size.  The  noise  parameter  interacted  with  target 
size,  but,  in  general,  higher  noise  levels  led  to  increased  thresholds.  The 
results  for  FLIR  2  (Figure  54)  were  less  straightforward.  The  recognition 
threshold  did  not  monotonically  decrease  with  increased  target  size  nor 
increase  with  increased  noise  levels.  A  comparison  of  the  two  figures  does 
indicate  that  performance  was  superior  using  the  FLIR  2  simulation. 
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Figure  24. 


Figure  25. 
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Percentage  Correct  Detection  Rate  for  FLIR  1,  Target  2 
as  a  Function  of  Target  Contrast 
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Percentage  Correct  Detection  Rate  for  FLIR  1,  Target  3 
as  a  Function  of  Target  Contrast 
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Figure  26.  Percentage  Correct  Detection  Rate  for  FLIR  1, 
Target  4  as  a  Function  of  Target  Contrast 
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Figure  27.  Percentage  Correct  Detection  Rate  for  FLIR  1, 
Target  5  as  a  Function  of  Target  Contrast 
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PERCENTAGE  CONNECT 


Figure  28 


NOISE  LEVEL 
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•  Percentage  Correct  Detection  Rate  for  FLIR  1, 
Target  6  as  a  Function  of  Target  Contrast 
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Figure  29.  Percentage  Correct  Detection  Rate  for  FLIR  2, 
Target  2  as  a  Function  of  Target  Contrast 


SIGNAL  TOP 

~T - 1 - 1 - 1 - 1 - - - 1 - —r- 

M  H  M  01  10  1?  I« 

CONTRAST 


Figure  30.  Percentage  Correct  Detection  Rate  for  FLIR  2, 
Target  3  as  a  Function  of  Target  Contrast 
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Figure  33.  Percentage  Correct  Detection  Rate  for  FLIR  2, 
Target  6  as  a  Function  of  Target  Contrast 


134 


Figure  34.  Percentage  Correct  Recognition  Rate  for  FL.IR  1 
Target  2  as  a  Function  of  Target  Contrast 
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Figure  35.  Percentage  Correct  Recognition  Rate  for  FL.IR  1, 
Target  3  as  a  Function  of  Target  Contrast 
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Figure  36.  Percentage  Correct  Recognition  Rate  for  FLIR  1 
Target  4  as  a  Function  of  Target  Contrast 
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Figure  37.  Percentage  Correct  Recognition  Rate  for  FLIR  1 
Target  5  as  a  Function  of  Target  Contrast 
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Figure  38.  Percentage  Correct  Recognition  Rate  for  FLIR  1, 
Target  6  as  a  Function  of  Target  Contrast 
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Figure  41.  Percentage  Correct  Recognition  for  FLIR  2, 
Target  4  as  a  Function  of  Target  Contrast 
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Figure  42.  Percentage  Correct  Recognition  for  FLIR  2 
Target  5  as  a  Function  of  Target  Contrast 
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Figure  43.  Percentage  Correct  Recognition  for  FLIR  2, 
Target  6  as  a  Function  of  Target  Contrast 
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Figure  44. 


Figure  45. 
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Percentage  Correct  Four-Bar  Recognition.Rate  for  FLIR  1, 
Target  2  as  a  Function  of  Target  Contrast 
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Percentage  Correct  Four-Bar  Recognition  Rate  for  FLIR  1, 
Target  3  as  a  Function  of  Target  Contrast 
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Figure  46. 


Figure  47. 
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Percentage  Correct  Four-Bar  Recognition  Rate  for  FLIR  1, 
Target  4  as  a  Function  of  Target  Contrast 
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Percentage  Correct  Four-Bar  Recognition  Rate  for  FLIR  1. 
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Figure  48.  Percentage  Correct  Four-Bar  Recognition  Rate  for  FLIR  1 
Target  6  as  a  Function  of  Target  Contrast 
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Figure  52. 
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Percentage  Correct  Four-Bar  Recognition  Rate  for  FLIR  2 
Target  4  as  a  Function  of  Target  Contrast 
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Percentage  Correct  Four-Bar  Recognition  Rate  for  FLIR  2 
Target  5  as  a  Function  of  Target  Contrast 
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Figure  53.  Percentage  Correct  Four-Bar  Recognition  Rate  for  FLIR  2, 
Target  6  as  a  Function  of  Target  Contrast 


Contrast  thresholds  for  the  detection  task  are  summarized  in  Figures  56 
and  57.  The  results  are  not  completely  straightforward  for  either  FLIR  1 
or  FLIR  2.  But  again,  thresholds  were  generally  lower  for  FLIR  2. 


CYCLES/PICTURE  WIDTH 


Figure  54.  Contrast  Threshold  for  Four-Bar  Recognition  as  a  Function 
of  Target  Size  for  FLIR  2 


Figure  55.  Contrast  Threshold  for  Four-Bar  Recognition  as  a  Function 
of  Target  Size  for  FLIR  1 
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Figure  56.  Contrast  Threshold  for  Detection  as  a  Function 
of  Target  Size  for  FLIR  2 


Figure  57.  Contrast  Threshold  as  a  Function  of 
Target  Size  for  FLIR  1 


Interestingly,  both  threshold  functions  for  FLIR  2  display  a  U-shape 
non- monotonicity.  Thresholds  for  the  largest  and  smallest  patterns  were 
higher  than  thresholds  for  the  second  largest  pattern.  This  finding  is 
consistent  with  previous  reports  of  the  shape  of  contrast  sensitivity  functions 

for  human  observers.  One  such  function  is  included  for  comparison  (Figure 

♦ 

58).  The  stimuli  were  square  wave  gratings  in  a  2  deg  square  field,  displayed 
at  a  mean  luminance  level  of  2.  7  ft-L.  The  conditions  are  comparable  with 
the  present  experiment. 


Contrast  thresholds  for  four-bar  recognition  were  also  used  to  obtain  the 
MRT  for  FLIR  1  and  FLIR  2.  The  MRT  was  calculated  from; 


*  Peak  Signal  -  Base  Signal 
JV^1  RMS  Noise 


x  NEAT  (°K) 


■Ml  I _ I - 1 - 

in  m 

cmfs/ncTunt  noth 

1  1-1 _ I - 1 — 

•  t»  in  IN 

CVClCt/VfWIAl  AMU 


J 


Figure  58.  Contrast  Threshold  as  a  Function  of  Target  Size 


*Schober  and  Hilz,  1965. 
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where  the  signal  and  noise  were  measured  in  digital  pixel  values.  NEAT 
for  FLIR  1  was  obtained  from  NVL  measurements  (0. 182K).  A  NVL 
predictive  model  was  also  used  for  FLIR  2. 


The  MRTs  for  each  of  the  three  noise  levels  in  the  FLIR  1  simulation  are 
shown  in  Figure  59.  The  MRT  prediction  of  the  NVL  model  is  also  indicated 
in  the  figure.  Figure  60  shows  the  three  measured  MRTs  for  FLIR  2  along 
with  the  MRT  NVL  prediction  model.  In  both  cases,  the  experimentally 
derived  MRT  s  have  a  shape  similar  to  the  predicted  MRTs  but  are  shifted 
downward.  This  indicates  that  the  simulations  produced  somewhat  more 
sensitive  MRTs  than  predicted.  The  measured  MRTs  do  not  show  the 
continued  downward  trend  with  decreasing  spatial  frequency,  as  the  models 
predict. 

DISCUSSION 

The  MRT  paradigm  was  adapted  to  digital  image  processing  and  standard 
psychophysical  methods.  Two  FLIRs  were  simulated,  one  a  first-generation 
FLIR  that  had  been  previously  assessed  by  the  NVL  model  and  the  other  a 
second-generation  FLIR. 

Detection  and  recognition  performance  were  measured  for  12  observers 
under  three  different  noise  conditions.  Four-bar  and  solid  square  targets 
of  various  sizes  were  used,  and  a  contrast  threshold  was  determined  for 
each  target  size,  noise  level,  and  FLIR. 
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Figure  59,  Analysis:  Comparison  of  NVL  MRT  Prediction 
to  Subject  Data,  FLIR  1 
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Figure  60.  Analysis:  Comparison  of  NVL  MRT  Prediction 
to  Subject  Data,  FLIR  2 
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Figure  61  compares  the  four- bar  recognition  results  (averaged  across  noise 

levels)  with  a  contrast  sensitivity  function  reported  for  similar  viewing 

* 

conditions  by  Schober  and  Hilz.  The  recognition  curves  for  FLIR  2  are 
similar  in  shape  to  the  CSF.  The  upward  translation  of  the  FLIR  2  curve 
may  be  due  to  higher  luminance  level  (10  vs  2.  7  ft-L)  or  to  differences  in 
threshold  criterion  (75%  correct  in  the  present  experiment).  The  similarity 
in  shape  was  not  wholly  expected  since  the  CSF  measures  detection  threshold 
while  the  FLIR  data  represents  recognition  data.  This  may  be  due  to  the 
fact  that  mean  luminance  is  kept  constant  in  CSF  experiments  but  was  not  in 
the  present  case.  Instead,  the  target  consisted  of  a  luminance  added  to  a 
constant  background.  Detection  of  the  target  becomes  a  luminance  increment 
judgment  which  has  different  characteristics  from  pattern  resolution  as 
measured  by  the  CSF.  However,  recognition  in  the  present  experiment 
requires  resolution  of  the  four-bar  target  as  distinct  from  the  solid  square. 
Such  a  judgment  may  be  quite  similar  to  that  demanded  in  standard  CSF 
measures,  which  require  discrimination  of  a  bar  target  from  a  homogeneous 
field  of  the  same  average  luminance. 

The  difference  between  the  shapes  of  the  FLIR  1  and  FLIR  2  recognition 
curves  may  reflect  many  factors.  Among  them  would  be  the  possibility  that 
the  MTF  of  the  visual  system  is  superior  to  that  of  FLIR  1,  so  that  the 
recognition  performance  becomes  limited  by  the  display  rather  than  by  the 
eye.  This  limitation  would  be  less  significant  in  the  case  of  FLIR  2.  Another 
way  of  putting  the  problem  is  to  say  that  FLIR  1  is  aperture- limited  whereas 
FLIR  2  is  noise-limited. 

Schober  and  Hilz,  1965. 


CONTRAST 


CYCIES/WCTUAE  WIDTH 

I _ I _ 1 _ I _ I _ I 

|  2.24  3. 73  S.H  *»  >*•** 


CYCIES/VISUAL  ANGIE 

Figure  61.  Analysis:  Comparison  of  Contrast  Sensitivity 
Function  with  Subject  Data 
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MRTs  were  derived  from  the  recognition  data,  and  a  comparison  of  Figures 
59  and  60  indicates  that  MRTs  were  substantially  lower  for  FLIR  2  than  for 
FUR  1. 

As  expected,  both  MRTs  tended  to  decrease  with  increasing  target  size 
(decreasing  spatial  frequency).  This  trend  was  not  maintained  for  the 
largest  target  sizes,  especially  in  the  case  of  FLIR  2. 

The  effect  of  different  noise  levels  was  again  somewhat  different  for  the 
two  FLIRs.  MRTs  decreased  with  increasing  RMS  noise  for  FLIR  2.  This 
tendency  was  also  observed  for  larger  target  sizes  with  FLIR  1,  but  not 
for  smaller  targets. 

The  MRTs  derived  from  recognition  performance  were  compared  with  MRTs 

>je 

based  on  the  NVL  model.  The  NVL  prediction  incorporates  a  variety  of 
hardware  parameters  such  as  detector  sensitivity,  field  of  view,  and  scan 
velocity,  as  well  as  observer  variables  such  as  the  signal- to- noise  ratio 
required  for  target  resolution,  visual  system  MTF,  and  temporal  integration 
time  of  the  eye.  The  present  experiment  simulates  the  hardware  parameters 
and  measures  the  observer's  performance  directly. 

The  experimental  results  for  FLIR  1  differ  from  the  NVL  prediction, 
particularly  in  the  middle  range  of  spatial  frequencies  (100  to  200  cycles/ 
PW).  The  sensitivity  in  this  range  reflects  the  size  of  the  detector  IFOV. 


Ratches,  et  al. ,  1975. 
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The  results  for  FLIR  2  differ  from  the  NVL  prediction  at  all  spatial 
frequencies.  For  spatial  frequencies  greater  than  100  cycles /PW.  the 
shape  of  the  curve  is  similar  to  that  predicted.  Over  this  range,  the 
experimental  data  and  model  may  be  described  as  differing  by  some  frequency 
independent  factor.  One  such  factor  could  result  from  the  use  of  forced- 
choice  procedures  which  sometimes  yield  lower  thresholds  than  the  method- 
of- limits. 

More  important,  however,  is  the  frequency- dependent  difference  that  is 
particularly  apparent  in  the  FLIR  2  data  (see  Figure  60).  Experimental 
MRTs  show  an  upturn  at  lower  spatial  frequencies  while  the  predicted  MRT 
continues  to  decrease. 

A  likely  explanation  for  this  discrepancy  is  that  the  normal  contrast  sensi¬ 
tivity  function  on  which  the  visual  system  MTF  is  based  is  characterized  by 
maximum  sensitivity  (minimum  threshold)  at  intermediate  target  spatial 
frequencies.  However,  the  NVL  prediction  models  this  MTF  with  a  negative 
exponential  function,  which  is  adequate  at  higher  spatial  frequencies  but 
does  not  exhibit  the  required  non- monotonic'  'v,. 

Such  a  discrepancy  is  usually  dismissed  as  insignificant  since  the  higher 
spatial  frequencies  are  presumed  to  be  of  greater  significance  for  most 
visual  tasks.  Recent  evidence  *  suggests  that  a  two-octave  band  of 
frequencies  centered  at  approximately  twice  the  fundamental  frequency  of 
an  object  may  be  the  most  important  for  recognition.  The  importance  of 
this  observation  for  modeling  thermal  viewing  systems  awaits  further 
investigation. 

Swets,  1964. 

^Ginsburg,  19. 


The  effect  of  different  noise  levels  differed  from  NVL  predictions. 

Noise  in  the  present  experiement  was  added  to  both  target  and  background 
so  as  to  maintain  a  constant  signal-to-noise  ratio  and  NEAT.  The  three 
different  rms  noise  levels  simulate  a  FUR  operating  with  different 
amounts  of  gain.  Since  signal-to-noise  and  NEAT  are  the  only  noise 
parameters  in  the  model,  it  was  predicted  that  the  changes  in  noise  level 
would  not  change  MRT.  It  was  expected  that  the  three  noise  levels 
representing  a  constant  NEAT  differing  only  in  gain  should  serve  as 
replications  with  AT/ rms  =  K. 

Several  explanations  of  this  discrepancy  are  possible.  The  first  is  that  the 
noise  effect  is  not  significant  but  merely  results  from  experimental  varia¬ 
bility.  However,  the  differences  between  the  lowest  and  highest  rms  noise 
results  exceeded  two  standard  errors  of  the  estimated  T.  In  addition,  the 
ordering  of  T's  for  different  noise  levels  was  consistent  throughout  the 
entire  range  of  spatial  frequencies  for  FLIR  2  and  much  of  FLIR  1. 

Another  possibility  is  that  the  higher  noise  levels  took  the  simulation  out 
of  the  range  of  linear  operation.  However,  the  documentation  that  preceded 
the  experiment  verified  that  the  system  operated  linearly  over  the  entire 
range  of  luminances  used  in  the  experiment. 

A  more  likely  explanation  is  that  the  differences  reflect  the  non-linear 
operation  of  the  visual  system.  In  particular,  the  addition  of  noise  to  both 

target  and  background  increased  the  mean  luminance  of  the  display  field, 

$ 

and  visual  sensitivity  generally  improves  with  higher  luminance.  However, 
the  effect  is  generally  smaller  than  that  observed  here. 

v  Patel,  1966. 
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The  present  results  can  be  compared  with  a  previous  study  by  Decker' 
which  had  similar  goals.  Decker  simulated  a  FLIR  display  with  videotaped, 
closed- circuit  television  imagery.  He  derived  MRTs  from  both  forced- 
choice  and  method- of- limits  bar  recognition  thresholds  for  a  variety  of 
FLIP /noise  viewing  conditions.  The  experimental  MRTs  were  compared 
with  several  models  including  that  of  the  NVL.  Decker  found  that  his  data 
fit  the  NVL  prediction  in  terms  of  shape  (frequency  independent)  but  also 
required  the  inclusion  of  a  multiplicative  constant  to  improve  the  fit.  Some 
of  Decker's  data  indicates  the  low  spatial  frequency  non-monotoncity, 
particularly  at  low  noise  levels.  This  agrees  well  with  the  results  reported 
here.  However,  Decker  reported  consistently  higher  MRTs  than  the  NVL 
prediction,  whereas  the  MRTs  reported  here  are  lower. 

The  results  of  this  experiment  indicate  that  FLIR  imagery  and  the  MRT 
measurement  paradigm  can  be  successfully  simulated  using  digital  image 
processing  and  standard  psychophysical  techniques.  This  approach  to 
FLIP  display  assessment  has  several  advantages  over  traditional  methods 
using  target  slides,  TV  camera,  and  CRT  monitor.  It  allows  greater 
flexibility  in  the  type  of  target,  FLIR  sensor,  and  viewing  conditions  being 
simulated  while  assuring  precise  control  of  the  important  parameters. 
These  include  simulation  of  the  MTF,  the  noise  of  the  FLIR,  and  the  raster 
effects,  as  well  as  the  linearity  of  the  entire  system.  Furthermore,  the 
extensive  calibration  and  documentation  discussed  in  Appendix  B  attest 
to  the  reliability  and  stability  of  the  simulation. 


* 


Decker,  1976. 
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Several  additional  advantages  are  realized  by  using  relatively  naive  obser¬ 
vers  in  a  standard  psychophysical  experiment.  Criterion  problems 

associated  with  the  traditional  method  of  limits  are  reduced  using  the 

* 

forced- choice  procedure. 

Few  special  qualifications  other  than  good  eyesight  are  required  of  the 
observer,  and  little  prior  training  is  needed  for  stable  results. 

We  conclude  that  the  advantages  of  these  techniques  are  such  that  they 
may  be  profitably  extended  to  other  types  of  FLIR  targets  and,  perhaps, 
other  subject  populations. 


Swets,  1964. 
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APPENDIX  A 


INSTRUCTIONS  TO  SUBJECTS 


During  the  experiment  you  will  be  asked  to  view  a  series  of  patterns  on 
the  TV  screen  in  front  of  you.  The  patterns  will  consist  of  either  a  solid 
square  or  four  vertical  bars,  displayed  against  a  background  of  visual 
noise  similar  to  the  "snow"  sometimes  seen  on  a  TV.  You  may  also 
notice  horizontal  lines,  but  these  are  irrelevant. 

The  contrast  (or  visibility)  of  the  patterns  will  vary  from  trial  to  trial. 

The  noisiness  of  the  background  and  size  of  the  pattern  will  remain  con¬ 
stant  for  a  block  of  50  trials,  then  change. 

On  each  trial  the  pattern,  either  bars  or  square,  will  appear  in  one  of  two 
positions  on  the  screen:  right  or  left  of  center.  The  distance  from  the 
center  of  the  pattern  to  the  center  of  the  screen  will  remain  constant 
throughout  the  experiment.  The  pattern  will  be  presented  for  about  five 
seconds  followed  by  a  one  second  interval  during  which  you  are  to  respond. 

Your  task  will  be  to  determine  where  on  the  screen  the  pattern  appears 
and  to  judge  which  shape,  bars  or  square,  is  presented.  The  appropriate 
responses  should  be  marked  on  the  answer  sheets.  If  you  are  unsure  about 
either  position  or  shape,  please  indicate  your  best  guess.  Remember, 
you  must  mark  an  answer,  even  if  you  do  not  think  you  saw  the  pattern. 
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Prior  to  each  block  of  50  trials  you  will  see  clearly  visible  examples  of 
the  bars  and  square  "displayed"  on  the  screen.  Pay  close  attention  to 
these  patterns  since  they  will  be  identical  in  size  and  shape  to  the  subse¬ 
quent  patterns. 

There  will  be  a  total  of  34  blocks  with  rest  periods  after  every  few  blocks. 
The  first  four  blocks  will  be  for  practice  only. 

Since  many  of  the  patterns  will  be  very  faint,  you  will  have  to  attend 
carefully  to  the  TV  screen. 

In  addition  to  the  $2  5  payed  for  your  participation,  there  will  be  a  $10  bonus 
for  the  one  who  performs  best. 

Do  you  have  any  questions  ? 


APPENDIX  B 


CALIBRATION  AND  DOCUMENTATION 


Prior  to  the  experiment,  the  performance  of  the  Model  70  imaging  system 
was  carefully  examined.  Four  levels  of  information  were  available  (see 
Figure  B-l): 

1)  Computer  Memory- -The  image  is  represented  in  computer 
memory  by  a  512  x  512  array  of  digital  pixel  values.  A 
listing  of  these  values,  ranging  from  0  to  511,  documents  the 
input  to  the  digital-tcranalog  converter. 

2)  Video  Signal- -The  D/A  converts  values  to  analog  video 
signals,  ranging  from  0.  0  to  0.  7  V.  Selected  horizontal 
video  lines,  corresponding  to  rows  of  the  digital  array, 
can  be  displayed  on  an  oscilloscope.  A  photograph  of 
the  video  signal  being  applied  to  the  TV  d  splay. 

3)  TV  Display- -The  resulting  luminance  pattern  ranges  from 
0.2  to  2  5.0  ft-L,  A  photometric  scan  across  the  face  of 
the  TV  monitor  documents  the  luminance  profile  of  the 
display. 

4)  Finally,  a  photograph  of  the  TV  display  indicates  the 
appearance  of  the  generated  image. 
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PHOTOGRAPH 


re  B  1.  Information  Flow  Through  FLIR  Simulation:  FLIR  1 
Four-Bar  Target 


DISPLAY  CHARACTERISTICS 


The  uniformity  of  the  TV  display  was  assessed  by  setting  all  of  the  pixel 
values  to  the  same  level.  Photometric  measurements  were  made  with  a 
Gamma  Scientific  photometer  calibrated  against  a  Gamma  Scientific  standard 
100  ft-L  source.  The  measurements  indicated  that  screen  luminance  varied 
less  than  ±  6%.  Within  the  area  used  during  the  experiment,  variability  was 
reduced  to  less  than  ±  3%.  Periodic  checks  over  a  four-hour  interval 
revealed  less  than  ±  3%  drift  in  the  display  luminance. 

Linearity  of  the  display  response  was  determined  by  measuring  the  video 
transfer  function  (VTF).  This  function  relates  output  luminance  to  input 
voltage.  The  contrast  and  gain  settings  on  the  display  were  adjusted  to 
produce  the  desired  range  of  luminance  (0.2  ft-L  to  2  5  ft-L)  for  the  given 
range  of  video  signal  voltages  (0.  0  to  0.  7  V).  Luminances  were  measured 
with  the  photometer  for  32  equally  spaced  voltage  steps.  It  is  apparent  from 
Figure  B-2  that  the  VTF  of  the  display  is  nonlinear. 

One  advantage  of  digital  image  generation  is  that  undesirable  characteristics 
of  the  system  can  be  modified  by  appropriate  program  changes.  In  the 
present  case,  we  were  able  to  compensate  for  the  nonlinearity  of  the  VTF 
by  supplying  a  set  of  conversion  values  in  the  program  that  produced  a 
linear  relation  between  digital  pixel  value  and  output  luminance.  This  was 
accomplished  by  empirically  mapping  the  512  pixel  values  into  unequal  voltage 
steps  that  yielded  equally  spaced  luminance  levels.  This  produced  a 
nonlinear  relation  between  pixel  values  and  voltages,  but  a  linear  relation 
between  pixel  values  and  luminance.  The  relationships  after  compensation 
are  illustrated  in  Figure  B-3. 
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Figure  B-2.  Video  Transfer  Function  of  the  Display  System 
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Figure  B-3.  Linearized  Video  Transfer  Function 
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It  is  apparent  from  the  above  discussion  that  the  intermediate  stage  of 
digital-to-analog  conversion  is  essentially  transparent  to  the  Model  70 
user;  that  is,  once  the  digital  values  are  calibrated  to  luminance  levels, 
one  can  largely  ignore  the  transformations  that  intervene.  Nevertheless, 
they  are  included  here  for  the  sake  of  completeness. 

With  the  display  operating  in  a  linear  relation  to  pixel  value,  the  system 
modulation  transfer  function  (MTF)  can  be  used  as  an  indicator  of  image 
quality.  *  The  MTF  in  the  horizontal  direction  was  derived  from  the 
square  wave  response  (SqWR)  measured  at  the  display.  Grid  patterns  were 
generated  by  the  computer  (pixel  values  of  0  and  511  for  brigh  :  and  dark 
bars,  respectively)  over  a  range  of  bar  widths  from  1  to  10  pixels.  A 
luminance  profile  was  obtained  by  scanning  the  display  horizontally  with 
a  masked  slit  microphotometer.  The  slit  was  vertically  oriented.  Its 
width  was  less  than  one  half  the  dimension  of  the  narrowest  bar  and  its 
height  exceeded  four  raster  lines.  A  representative  luminance  profile 
and  corresponding  oscilloscope  tracing  showing  D/A  output  are  reproduced 
in  Figure  B-4.  The  MTF  was  derived  from  the  SqWR  by  the  standard 
series  expansion*  and  is  given  in  Figure  B-5.  There  was  no  significant 
roll-off  in  the  range  of  bar  widths  used  in  the  experiment  (3-30  pixels /bar 
width). 


^Strictly  speaking,  MTF  techniques  assume  linearity,  shift  invariance,  and 
continuous  response  of  the  system.  The  slight  nonuniformity  of  the  display 
violates  the  first  assumption,  and  digital  pixel  values  violate  the  third. 

t 

Coltman,  1954. 
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Figure  B-5.  MTF  of  FLIES  1  and  2  Comparing  Sine  and 
Square  Wave  Response  Measures 

TARGET  CHARACTERISTICS 


Oscilloscope  records,  luminance  profiles,  and  display  photographs  were 
also  obtained  for  the  four-bar  target  patterns.  For  the  first  set,  no  line 
spread  function  was  applied  to  the  target  (see  Figures  B-6  to  B-ll.  The 
MTF  was  obtained  in  the  same  fashion  as  above  and  is  also  shown  in  Figure 
B-5.  As  expected,  the  MTF  derived  from  targets  corresponds  closely 
with  that  derived  from  the  grid  pattern.  The  slight  discrepancy  at  higher 
spatial  frequencies  may  reflect  increased  light  scatter  due  to  higher  dark 
bar  luminance  (pixel  values  of  200  instead  of  0)  used  during  these  measure¬ 
ments. 
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Figure  B-6 
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c.  Photograph 


.  No  Point  Spread  Function  Documentation  for 
Target  1  (concluded) 
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LUMINANCE  (ft  L) 


a.  Oscilloscope  Tracing 


( 


b.  Luminance  Profile 

Figure  B-7.  No  Point  Spread  Function  Documentation  for  Target  2 
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c.  Photograph 


Figure  B-7.  No  Point  Spread  Function  Documentation  for 
Target  2  (concluded) 
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LUMINANCE  (ft  L) 


a.  Oscilloscope  Tracing 


b.  Luminance  Profile 

Figure  B-8.  No  Point  Spread  Function  Documentation  for  Target  3 
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LUMINANCE  (ft  L) 


c.  Photograph 


Figure  B-9.  No  Point  Spread  Function  Documentation  for 
Target  4  (concluded) 


LUMINANCE  (ft  L 


c.  Photograph 


Figure  B-10.  No  point  Spread  Function  Documentation  for 
Target  5  (concluded) 


178 


(ft  L) 


a.  Oscilloscope  Tracing 


b.  Luminance  Profile 

Figure  B-ll.  No  Point  Spread  Function  Documentation  for  Target 
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For  the  second  set  of  records,  the  line  spread  function  derived  for  FLIR  1 
was  applied  to  each  target  (see  Figures  B-12  to  B-17).  The  MTF  obtained 
from  the  SqWR  is  compared  with  the  MTF  of  the  FLIR  being  simulated 
(obtained  from  product  specifications)  in  Figure  B-5.  The  two  MTFs  agree 
quite  closely,  indicating  that  the  simulation  is  valid. 

The  third  set  of  records  is  for  the  FLIR  2  (see  Figures  B-18  to  B-23).  and 
the  MTF  derived  from  the  SqWR  is  again  compared  with  product  specifica¬ 
tions  in  Figure  B-5.  The  MTF  and  sine  wave  response  agree  at  higher  and 
lower  spatial  frequencies.  For  intermediate  frequencies,  the  sine  wave 
response  was  somewhat  less  than  expected. 

NOISE  CHARACTERISTICS 

A  representative  oscilloscope  recording  of  the  four- bar  target  in  noise  is 
provided  in  Figure  B-24.  Figure  B-25  shows  the  appearance  of  such  a 
display.  Since  the  noise  was  dynamic  and  the  response  of  the  photometer/ 
strip  chart  recorder  relatively  slow,  no  luminance  profile  was  obtained. 

The  three  noise  levels  used  in  the  experiment  were  verified  using  the  tan¬ 
gential  method.*  The  noise  signal  from  the  digital- to- analog  converter  was 
applied  to  both  channels  of  a  dual  beam  oscilloscope.  The  two  noise  traces 
were  positioned  adjacent  to  one  another.  When  the  noise  signal  was  re¬ 
moved,  the  separation  of  the  two  traces  indicated  twice  the  RMS  noise  level. 
It  was  determined  that  the  three  noise  levels:  40,  80,  and  160  (digital  pixel 
values)  corresponded  to  0.033V,  0.065V,  and  0.130V  RMS,  as  expected 


^Franklin  and  Halley,  1973 


Figure  B-13.  FLIR  1  Documentation  for  Target  2 
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LUMINANCE  (ft  L) 


a.  Oscilloscope  Tracing 


b.  Luminance  Profile 

Figure  B-14.  FLIR  1  Documentation  for  Target  3 
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c.  Photograph 


Figure  B-14.  FLIP  1  Documentation  for  Target  3  (concluded) 


LUMINANCE  (It  L) 


a.  Oscilloscope  Tracing 
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b.  Luminance  Profile 

Figure  B-15.  FLIR  1  Documentation  for  Target 
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c.  Photograph 


Figure  B-15.  FLIR  1  Documentation  for  Target  4  (concluded) 


c.  Photograph 


Figure  B-16.  FLIR  1  Documentation  for  Target  5  (concluded) 
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c.  Photograph 


Figure  B-17.  FLIR  1  Documentation  for  Target  6  (conclude 
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LUMINANCE  (It  L) 


c.  Photograph 


Figure  B-18.  FLIR  2  Documentation  for  Target  1  (concluded) 
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b.  Luminance  Profile 

Figure  B-19.  FLIR  2  Documentation  for  Target  2 
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c.  Photograph 


Figure  B-19.  FLIR  2  Documentation  for  Target  2  (concluded) 


LUMINANCE  (ft  L) 


a.  Oscilloscope  Tracing 


b.  Luminance  Profile 

Figure  B-20.  FLER  2  Documentation  for  Target  3 
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c.  Photograph 


Figure  B -20.  FLIR  2  Documentation  for  Target  3  (concluded) 
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a.  Oscillos 


b.  Lumina 


Figure  B-21.  FLIR  2 
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Figure  B-2 


c.  Photograph 


.  FLIR  2  Documentation  for  Target  4  (concluded) 
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LUMINANCE  (ft  L) 
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a.  Oscilloscope  Tracing 


b.  Luminance  Profile 

Figure  B-22.  FLIR  2  Documentation  for  Target  5 
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c.  Photograph 


Figure  B-22.  FLIR  2  Documentation  for  Target  5  (concluded) 
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a.  Oscilloscope  Tracing 


b.  Luminance  Profile 

Figure  B-23.  FLIR  2  Documentation  for  Target  6 
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c.  Photograph 


Figure  B-23.  FLIR  2  Documentation  for  Target  6  (concluded) 


Figure  B-24.  Representative  Oscilloscope  Recording  for  a 
Four-Bar  Target  (Number  5)  in  Noise  (160) 


The  tangential  method  and  the  simulation  itself  depended  on  a  Gaussian 
distribution  of  noise  levels.  This  was  also  verified  by  obtaining  the  list 
of  digital  pixel  values  stored  in  computer  memory  that  determined  noise 
signal.  The  distribution  of  pixel  values  was  found  not  to  deviate  signifi¬ 
cantly  from  the  assumed  Guassian  distribution. 


APPENDIX  C 


INDIVIDUAL  SUBJECT  DATA 


Each  cell  of  the  following  tables  represents  the  number  of  correct 
responses  out  of  10  trials,  unless  otherwise  specified,  for  both  four-bar 
and  square  targets.  Both  signal  top  (digital  value)  and  target  contrast 
are  indicated  for  the  five  luminance  levels  under  each  noise  condition. 
Target  contrast  was  calculated  as  follows: 
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TABLE  04.  FLIR1:  DETECTION— TARGET  5 
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TABLE  05.  FLIR  1:  DETECTION- -TARGET  6 


TABLE  06.  FLIRl;  RECOGNITION— TARGET  2 


Moan  x  I  57*  50 1  55.  00  167.  50 


RECOGNITION- -TARGET  3 


215 


TABLE  08.  FLIR  1:  RECOGNITION- -TARGET  4 
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TABLE  C-10.  FLIR1:  RECOGNITION— TARGET  6 
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TABLE  C-ll.  FLIR  2:  DETECTION- -TARGET  2 
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TABLE  C-12.  FLIR  2:  DETECTION- -TARGET  3 


ITS 

222 

C^’ 

m 

o 

© 

© 

Cj 

9/9 

8/9 

6/8 

o 

10 

10 

© 

© 

10 

10 

93.98 

o 

0 

CM 

0.  034 

~ 

11/11 

*— < 

r- 

© 

© 

© 

© 

10 

© 

© 

c- 

© 

© 

© 

> 

4> 

—  o 

CO 

o>  ~ 
a 

CO 

208 

0.020 

© 

© 

© 

B 

m 

© 

■ 

B 

© 

B 

63.33 

o 

Z 

cm 

204 

0.010 

© 

4/9 

2/9 

© 

in 

© 

© 

© 

© 

© 

© 

I'- 

© 

cr 

in 

- 

202 

0.005 

in 

in 

in 

© 

© 

© 

B 

© 

52.50 

in 

222 

0.052 

© 

10 

© 

© 

© 

o 

10 

© 

"3 

D 

214 

0.  034 

11/11 

11/11 

It/II 

li/n 

© 

© 

10 

95.  71 

ise  Lev 
80 

CO 

00 

© 

CM 

0.020 

6/6 

6/6 

8/9 

© 

© 

© 

© 

© 

89.  68 

z 

M 

204 

0.010 

10/11 

9/11 

X  X  /  9 

6/11 

© 

© 

r- 

r- 

© 

in 

r- 

r 

202 

0.005 

5/9 

2/9 

2/9 

5/9 

© 

ers 

r- 

45.08 

m 

222 

0.052 

© 

o 

© 

H 

10 

© 

*-4 

10 

10 

© 

B 

© 

© 

10 

_ 

cr 

00 

in 

© 

E 

214 

0.034 

10 

© 

H 

© 

10 

o 

© 

10 

© 

10 

© 

© 

© 

be 

in 

© 

V 

J© 
a>  ■** 

CO 

CO 

00 

o 

CM 

0.020 

© 

© 

10 

10 

© 

© 

© 

fH 

© 

© 

r- 

© 

86.67 

z 

CM 

© 

CM 

0.010 

oc 

t- 

r- 

© 

r- 

I— 

1- 

in 

in 

67.50 

1  ^ 

202 

0.005 

in 

in 

cn 

© 

cn 

cr 

f- 

© 

© 

© 

© 

52. 50 

[  Signal  Top: 

|  Target  Contrast: 

< 

a 

o 

a 

u 

u.  e 

sioafqns 

= 

- 

z 

- 

Mean  x 

220 


DETECTION— TARGET  4 


Mean  x  I  60. 00  I  76.  57  1  91 . 74  98.  33  I  100.  00  59. 26  69.  09  90.  83  I  93.  33  I  99. 1 7  I  57.  50  I  65.00  I  73. 33  J  95.  83  100.00 


TABLE  C-14.  FLIR2:  DETECTION— TARGET  5 
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Meanx  1  51.541  75.  00  92  .  50  1  95.  00  96.  89  60. 1 9  75.  00  94.  24  98. 24  I  99. 17  60.  00  70. 00  I  88.  33  |  96.  74  I  96. 67 


-15.  FUR  2:  DETECTION— TARGET  6 
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TABLE  C-16.  FUR  2:  RECOGNITION— TARGET  2 
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Mean  x  I  50.  86 1  50.  81 


TABLE  C- 17.  FLIR2:  RECOGNITION— TARGET  3 


Mean  *  I  30.  00  46.  67 


TABLE  C-18.  FUR  2:  RECOGNITION-TARGET  4 


Mean!  |40. 00  64.81 


TABLE  C-19.  FUR  2:  RECOGNITION- -TARGET  5 
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Means  136.  30  I  67.50  190.00  94. 17  97.65  34.  54  70.  00  90.  98  98.  33  1 00.  00  I  33.  75  I  55.  00  |  77.  50  I  95.  91  95.83 


TABLE  C-20.  FLIR  2:  RECOGNITION— TARGET  6 


Mean  x  1 30.  88  5G.  67  92. 96  95. 91  98.  33  32. 50  50.00  88.  75  98, 75  98.  75  2  7. 50  40.00 
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